DOCUMENT RESUME 



ED 072 6*1 



EM 010 731 



Fletcher, J. D.; And Others 

Computer- Assisted Instructi i for the Deaf at 
Stanford University. Annual Report. 
Stanford Univ., Calif. Inst, for Mathematical Studies 
in social Science. 
■ Bureau of Education for the Handicapped (DHEW/OE) , 
Washington, D.C. 
14-2280 
8 Jan 73 

OEG-0-70-4797 (607) 
118p. 

MF-S0.65 HC-f6.58 

♦Annual Reports; ^Computer Assisted Instruction; 
Curriculum Development; *Deaf Children; *Deaf 
Education; Formative Evaluation; Individualized 
Instruction 
IDENTIFIERS Stanford University 

ABSTRACT 

The 1971-1972 annual report on Stanford University's 
project to develop and research computer-assisted instruction 
curricula for deaf students describes the full range of project 
activities for the year. The programs available to the schools are 
described, along with the participating systems and research 
conducted during the year to improve the courses. (RH) 
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Introduction 



This project continued research and development of curriculums for 
hearing impaired students rising computer-assisted instruction (CAl). 
Curriculums developed by the Institute for Mathematical Studies in the 
Social Sciences (IMSSS) at Stanford University were used by more than 
■1,000 hearing impaired students during the 1970-71 .'school year and by 
more than 2,000 hearing impaired students during the 1971-72 school year*. 
The project has generated much interest and support among educators in 
schools for the deaf and hard of hearing throughout the country. 

The project was begun in June 1970 under Grant No. OEG-0-70-l*797(607) 
as 0E Project No. lU-2280. Present funding continues through October 31, 
1972. The original proposal was submitted by IMSSS to the Bureau of Educa- 
tion for the Handicapped on October 16, 1969 and revised on April 1, I97O. 
The original proposal covered the three and a half-year period starting 
June 1, 1970 and ending December 13, 1973. 

1970-71 

The original proposal for this project was prepared by IMSSS in 
cooperation with three schools for the deaf and one school -district that 
had already indicated great interest in having CAI curriculum for their 
deaf students. These were the California School for the Deaf in Berkeley, 
California; the Kendall School for the Deaf in Washington, D.C. ; the San 
Jose Unified School District in San Jose, California, which has day classes 
for the deaf in four schools; and the Texas School for the Deaf in Austin, 
Texas. St^dents^ at all of these schools regularly used Stanford CAI 
courses during the 1970-71 school year. 

In addition to the four schools that participated in the original 
proposal, one other school and one other school district joined the pro- 
ject for the 1970-71 school year. These were the Model Secondary School 
for the Deaf (MSSD), which is located near Kendall School on the campus 
of Gallaudet College in Washington, D.C., and the Palo Alto" Unified School 
District in Palo Alto, California, which used CAI for deaf students from 
three schools. Both of these were able to- find funding from other sources 
to support their student terminals. The Palo Alto School District in- 
cluded the Stanford terminals as part of a larger experiment using CAI 
for deaf students; they also used teacher-prepared CAI curriculum imple- 
mented on their own computer system. The final report on this project 
is available from Mrs. Ruth Jackson, Program for the Deaf and Hard of 
Hearing, Palo Alto Unified School District, 25 Churchill Avenue, Palo 
Alto, California. 

During the 1970-71 school year there were 60 terminals in operation 
at the participating schools. Over 1,000 deaf students used one or more, 
of this Stanford CAI courses. Detailed information about distribution of 
teletypes and course usage is given in Sections II and III of the annual 
report for 1970-71. 
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All of the schools that participated, in the project during the 
1970-71 school year continued during the 1971-72 school year, and several 
. new schools joined the project. The schedule originally proposed that 
one new . school vith 15 terminals would be added during the 1971-72 school 
yea-r. However, so many schools for the deaf expressed interest in having 
CAI terminals that the decisipn was made . to offer teletypes on a 50-50 
cost-sharing basis and thereby to allow more schools to join. The Florida 
State School for the Deaf and the Blind in St. Augustine, Florida, was 
added October 1". The Florida School is a state residential school that 
has about ^75 students in grades kindergarten through high school. Ten 
terminals were installed in the Oklahoma School for the Deaf in Sulphur, 
Oklahoma. The Oklahoma School is also a state residential school; it has 
approximately 225 students ranging from preschool through high school. 

Five new locations were, added in Texas under the state's dey school 
program. Texas has seven county- wide day schools for deaf students, and 
CAI terminals were installed in five of these schools. Four terminals 
were installed in the Houston Independent County-Wide Day School in 
Houston, Texas; two in the Bexar County Day School for the Deaf in San 
-Antonio, Texas; three ia the Dallas County Bay- School for the Deaf in 
Dallas, Texas: two in the Tarrant . County Day School for the Deaf in Fort 
Worth, Texas; one in "the Beaumont BU County Wide Day School for the Deaf 
"in Beaumont, Texas. 1 

The telephone line cos*? for the Texas county-vide day schools, the 
Texas School for the Deaf in Austin, and the Oklahoma School for the Deaf 
in Sulphur were educed by the creation of a combined circuit. A Micro 
800 "computer was installed at the Texas School in Austin in- the same room 
as the teletypes. The Micro 800 will allow **8 data channels to be multi- 
plexed; before, with Collins equipment, only 15 channels could be .multiplexed. 

All schools for the hearing. impaired that participated in the IMSSS 
project during the 1971-72 school year, including number of CAI tezsninals 
installed and percentage of financial support provided by the project's 
OE funds, are listed in Table 1. 

Summary of CAI Curriculums Available to Participating Schools 

All CAI curriculums developed by IMSSS are available to students in 
the participating schools for the deaf. Some IMSSS curriculums, such as 
reading (grades K-3), French, and Russian, are inappropriate because they 
require audio. However, mos ; t of the curriculums, even though not speci- 
fically designed for hearing-impaired students, are being used successfully 
by the participating' schools. A list of IMSSS curriculums with the numbers 
of hearing- impaired students who used them in 1971-72 is presented in Table 
2. Brief descriptions of curriculums other than the math strands and 
language arts courses discussed later follow. 



TABLE 1 

Participating Schools -in 1971-72 



School 

California School for the Deaf 

at Berkeley- 
Florida State School for the Deaf 

and the Blind 

Kendall School for the Deaf 

Model Secondary School -for the Deaf 

Oklahoma School for the Deaf 

Palo Alto Unified School District 
(February' 10, 1972- June 10, 1072) 

.San Jose Unified School District 
Bachrodt Elementary School 
Hester Elementary School 
Hoover Junior High School 
San Jose High School 

Texas County-Wide Day Schools 

Houston Independent County-Wide 
Day School 

Bexar County Day School for the Deaf 
(San Antonio) 

Daliis County Day School for the Deaf 

Tarrant County Day School for the Deaf 
(Fort Worth) 

Beaumont BL- County Wide .Day School for 
the Deaf . 



Terminals 
15 

8 

12 
.8 
10 
2 

2 
2 
1 
1 

k 
2 

3 
2 



Texas School for the Deaf 



Total 



88 



Support* 
100 

. 50 

"100 
0 

- 50 
0 

100 
100 
100 
100 

50 

50 

50 
50 

50 

100 



^-Percentage of financial support of CAI terminals provided by 0E funds. 
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TABLE 2 

Institute CAI Curriculums Used tyr Participating 
Schools for the Deaf r 1^1-72 



Curriculum Number of students 

Algebra 83 

Basic English 165 

Computer Programming in AID 93 

Computer Programming in BASIC , . 22k 

Language Arts 1071 

Logic and Algebra • - 216 

Elementary Mathematics (Strands) 211*6 

Arithmetic Word Problem Solving 107 

Total Students 2279, 



j Logic and Algebra . This course is .designed for secondary school 
students. The first year introduces numerical and sentential variables, 
foiraation of algebraic teiros and sentences, and truth conditions of simple 
sentences. The second year of the course is concerned with the founda- 
tions of algebra, from a small set of axioms and rules of inference the 
properties of the field of rational numbers are developed. 

Algebra . Algebra is a self-contained tutorial course designed for 
secondary school students. It teaches the basic properties of arithmetic 
operations, simplifying and solving equations and the properties of in- 
equalities. Each lesson contains instruction, printed homework, corrections 
of homework problems on the computer and a quiz. There are currently 25 
lessons available. The course is still under development. 

Basic English . This course is designed to provide secondary school 
students with practice in problem areas of standard English usage. The 
objective of the course is to diagnose and correct the twelve most common 
usage errors: run-on sentences, sentence fragments, incorrect principal 
parts of the verb, confusion of adjectives and adverbs, lack of agreement 
between subject and verb, lack of agreement between pronoun and antecedent, 
incorrect case of pronouns, vague or indefinite proriomial reference, dan- 
gling elements, misplaced modifiers, errors in comparative forms of 
adjectives and adverbs, and double negatives. 

Computer Programming in BASIC . This is a self-contained course for 
secondary students. It provides an introduction to programming for stu- 
dents without a knowledge of algebra. The course consists of 50 lessons, 
about one hour in length, plus summaries, reviews, and self tests. 

Computer Programming in AID . This is a self-contained, tutorial 
program that teaches the use of Algebraic Interpretive Dialogue (AED), a 
high-level algebraic language. The course was designed for junior college 
students and requires at least one year of algebra background. The course 
consists of 50 lessons, about one hour in length, plus summaries, reviews, 
tests, and extra-credit problems. 

Arithmetic Word Problem Solving . The course presents a graded series 
of 700 arithmetic word problems (with stored text and program-generated 
values). The student uses the computer to do the calculations, and is 
thereby free to concentrate on problem solutions which he enters as 
algebraic strings (e.g., A + B X 3). The program contains various levels 
Of generated and explicit hints for the student. The course can be used 
in conjunction with the elementary mathematics program. The problems can 
be presented in English or in Spanish. 

Games 

1 

There are several games available to student users. Although they 
are called games and are entertaining to use, they are seldom without 
redeeming pedagogical value. 




Bagels , This game is properly called Pico-Fermi-Bagels. The program 
creates a 3-digit number at random, and the student-player is to try to 
guess it. If one of the digits he guesses is correct' but in the wrong 
position, he is told PICO. If one of the digits- he guesses is correct 
and in the correct place, he is told FEME. If none of the digits he 
guesses is correct, he is told BAGELS. He has 20 chances to guess the 
number. 

Hangman . Hangman is the familiar game that most American children 
play in elementary school. In the 3MSSS version, a definition or hint 
for a word is given, and the student-player is given six chances to guess 
the word by giving the letters that belong in it. The figure being hanged 
is "drawn" by the teletypewriter. Three vocabulary lists are available 
for the game. Before beginning, the student-player must select the easy, 
medium, or hard list. Hangman is also availabievin a Spanish version. 

Poster . Poster creates a poster by taking in any number of lines of 
text and enlarging the characters in each line to fill up the (8-inch) 
width of the teletypewriter paper. 

. Spell . fc In Spell, a word is typed and the student-player must indi- 
cate if it is spelled correctly or incorrectly. If the word-is incorrect, 
the student-player must supply the correct spelling. 

Spanish . In Spanish, a word is given in Spanish or English, and the 
student-player must translate it to English or Spanish, respectively. All 
instructions and hints are given in Spanish. 

Tictac . Tictac is tic-tac-toe presented by teletypewriter. * The 
student-player may assign to the compute* (and to himself by implication) 
a»j- one of four levels of ability: beginner, average, good, and grand 
master. 

The Stanford CAI System 

The central processor for the Instituted computer system is a Digital 
Equipment Corporation PDP-10. In addition to core memory, short-term stor- 
age of programs and student information is provided by eight 180,000,000- 
bit disk modules. Long-term storage of student response data is provided 
by magnetic tape. About 280,000,000 bits of information can be stored by 
the system on one magnetic tajpe. Communication with remote student ter- 
minals in participating schools is provided by telephone lines. Fifteen 
student terminals anywhere in the country can communicate with the Institute 
system using only one ordinary telephone line. For communication with 
clusters of j£ or more terminals, high-speed data lines routinely provided 
by the telephone company are used. In 1971-72, more than 180 terminals 
were connected to the Institute system. About 90 of these terminals could 
be used simultaneously with no appreciable detriment in the system's speed 
of response. Any curriculum or other program- could be run at any time on 
any student terminal* 
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The student terminals themselves are ,f KSR Model 33" teletypewriters. 
These teletypewriters communicate information to and from the central 
computer system at a rate of about 10 characters per second. They provide 
no audio, visual, or graphic capability, but their cost is about one-tenth 
of terminals that do. Despite their limitations, these inexpensive ter- 
minals have permitted development of CPJ: that has produced dramatic gains 
in pedagogical achievement for hearing students as Suppes and Morningstar 
(1970), Fletcher and Atkinson (1972), and others have reported. For that 
matter, Jamison, Fletcher, Suppes, and Atkinson (1972) have argued that 
for cost-effectiveness, CAI, using satellite communication, is superior 
to all other methods in providing compensatory education. 

Mathematics Strands Program 

Introduction 

Three experiments were performed during 1971-72 to evaluate the 
effectiveness of the Stanford/CAE Mathematics Strands curriculum with 
deaf and hard of hearing students. Experiment I examined the effect of 
number of math strands sessions on test performance. Experiment II 
investigated the feasibility of successfully predicting the amount of 
on-line instructional intervention each student needs to meet an individ- 
ually prescribed performance ^oal. Intervention took the form of extra 
sessions at the terminal. Both Experiment I and II used as external pre- 
and post- tests a modified Stanford Achievement Test (MSAT), administered 
to the student at the computer terminal. Experiment III tested the 
concurrent validity of grade placement (GP) measured by the MSAT, by 
comparing MSAT GP with GP measured by paper and pencil administrations 
of the Stanford Achievement Test (SAT). Results from Experiments I and 
III are reported by Suppes, Fletcher, Zanotti, Lorton, and Searle (1972) j 
results f ran' Experiment II are reported by Suppes, Fletcher, and Zanotti 
(1972). 

The students who participated in these studies- were chosen f rem 
among th<* entire population of deaf students who received CAI in mathe- 
matics and language arts during 1971-72. Degree of hearing loss among 
the students is essentially that adopted for admission standards by the 
schools for the deaf participating in the experiment. Usually, this 
loss is at least 60 decibels in the better ear. Students selected by the 
schools for CAI generally represent a cross section of their secondary 
school population. Some students may be significantly handicapped in ways 
other than that of hearing loss, but these additional handicaps will not 
have prohibited them from meeting elementary school graduation requirements. 

Description of the IMSSS Mathematics Strands Program 

The objectives of the program are (1) to provide supplementary in- 
dividualized instruction in elementary mathematics at a level of difficulty 
appropriate to each student f s level of achievement,. (2) to allow acceler- 
ation in any concept area in which a student demonstrates proficiency and 
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repeated drill in areas of deficiency, and (3) to provide a daily profile 
report of each student 1 s progress through the curriculum. 

A strand is a seri.es of problems of the same operational type (e.g., 
number concepts, addition, subtraction, fractions) arranged sequentially 
in equivalence classes according to their relative difficulty. The Ik 
strands in the progrci and the grade levels spanned by each strand are 



Number Concepts 


1.0-?.9 


Horizontal -Addition 


1.0-3.9 


Horizontal Subtraction 


1.0-3.^ 


Vertical Addition 


1.0-5.9 


Vertical Subtraction 


1.5-5.9 


Equations 


1.5-7.9 


Measurement 


1.5-7.9 


Horizontal Multiplication 


2.5-5.4 


Jams of Arithmetic 


3.0-7.9 


Vertical Multiplication 


3.5-7.9 


Division 


3.5-7.9 


Fractions 


3.5-7.9 


Decimals 


U.0-7.9 


Negative Numbers 


6.0-7.9 



A student in the strains program will work on fewer than Ik *trandsj 
the actual number will depend on his grade level and performance. The 
strands approach provides a high degree of individualization because 
each students lesson is prepared for him daily by bhe computer, the 
lessons are presented as mixed drills at a level of difficulty in each 
concept determined by the student's prior performance in each concept, 
and the student moves up each strand at his own pace* 

The Test Instrument: The Modified SAT 

Description of the SAT * The arithmetic computation section of the 
Stanford Achievement Test (SAT) was used as a guide for the Uevelopnient 
of an achievement test (MSAT) that can be administered at the computer 
terminal. The arithmetic computation sections of three SAT butteries, 
Primary II, Intermediate I and Intermediate II, were used as models* For 
all three levels, forms W and X were examined* 

Computation problems on the Primary IX test are worked in the test 
booklet* All of the questions on the computation sections of the Inter- 
mediate level tests (I and II) are multip le choice and responses are 
entered in the test booklet or on a standard answer sheet* The responses 
are letters between a and «}. Sach question has four or five possible 
responses; the letters a-d an£ a-e used for one question, the letters 
e-h or f-J for the next question. 

Several properties of the tests are shown in Table 3. The table 
contains, for each level, the number nf problems, the time allowed for 
administration, and the grade placement corresponding to error rates of 
•15, ^50 and .25* These last figures are shown separately for forms 
W and X. 
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TABLE 3 

Characteristics of Computation Section of the SAT 



Test Level 


Number of 
Problems 


Time 
Min- 


. Placement 
on Form W 




Placement 
on Form X 










.25 


l50 


♦75 


.25 


♦ 50 




Primary II 


• 60 


30 


2.k 




k.k 


2.2 


3.3 


4.4 


Intermediate I 


39 . 


35 


3.5 


k.6 


5.8 . 


3.5 


U.7 


6.0 


Intermediate II 


39 


35 


k.k 


6.1 


3.5 


k.6 


6.2 


8.7 


Construction of the MSAT. 


Three 


sets 


of parallel items were con- 





structed for each item occurring in the computation sec+ioxi of xhe SAT. 
The method us^d to construct items depended on v/hether or not the item 
was of a type that appears in the math strands CAI curriculum. 

Each SAT problem of a. type thiz occurs in the CAI curriculum was 
labeled with the equivalence class number into which it fits. Both forms 
(W and X) were examined and labeled. If similar items for both forms 
fell in the same equivalence class, three items from that equivalence 
class were used. If this was not the case, a new class definition was 
constructed that included the attributes of both classes, and three prob- 
lems were written to fit this class definition. The class numbers 
obtained are presented in Table k for Primary II, Table 5 for Interme- 
diate I, and Table -6 for Intermediate II. 

If a test problem was of a type that does not occur in the strands 
curriculum, a new "class" definition was written *that describes the 
salient features of the exemplars from both tests forms. Then three 
items were written using the class definition. 

A careful analysis was made of the answer choices presented in In- 
termediate I and II. For both test levels there are four problems for 
which the correct answer is "net given." Four problems were similarly 
constructed for the MSAT# The wrong answers to addition problems differ 
from the correct answer in one digit that may occur in any but the left- 
most position. The. wrong answers to subtraction problems differ from 
the correct answer in one digit that may occur in any but the left-most 
position, or the left-most digit may be one less than that of the correct 
answer. 
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TABLE If 

Characterization of SAT Problems by Math Strands Equivalence Class 

Primary II 



Equivalence Problem Number Problem Number Problem Number 
Class Number Form X Form W MS AT 



VSU 2.00 


1 


3 . 


1 


VSU 2.10 


2 


2 


2 


VSU 2.10 


3 


6 


3 


VSU 2.10 


If 


5 


k 


VSU 2.10 


5 


if 


■ 5 


VSU 2.10 


6 




6 


VSU 1.80 




l 


6 


HAD 2.00 


7 




7 


HAD 2.10 




I 


7- 


HSU 2.60 


ft 


O 
O 


8 


VAD- 2.65 


Q 

y 




9 


VAD 3.10 


IX) 


9 


10 


VAD 3.1b' 


11 


u 


u 


HAD 2.80 


12 


12 


12 


vsu 2.95 


13 


13 


13 


vsu 2.70 


Ik 


llf 


llf 


vsu 2.95 


15 


15 


15 


HSU 2.20 


16 


16 


16 


VAD If.OO 


17 


17 


17 


VAD If.OO 


18 


18 


18 


VAD' If.OO 


19' 


19 


19 


VAD If.OO 


20 


20 


20 


HAD 2.80 


22 


21 


21 


HAD 2.80 


21 


22 


22 


HAD 2.80 


23 


23 


23 


HAD 2.80 


2k 


2k 


2lf 


HAD 2.80 


25 


25 


25 
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TABLE 4 (cont'd) 



Equivalence Problem Number 
Class Number Form X 


Fcxnn W 


Problem Number 
MS AT 


(None: See Note 1) 


26 


do " 


26 


vsu 3.15 


27 




27 


vsu 3.15 


28 


oA 


2o 


vsu 3.15 


29 


29 


29 


vsu 3.15 


30 


.30 


30 


vsu 3.15 


31 


31 


31 


vsu 3»15 


32 - 


• 32 


32 


Tf ATX I* 1* f\ 

VAD 4.40 


33 


33 


33 


VAD 5* 10 


34 


3k 


3k 


VSU 4.10 


35 


35 


35 


■trr»TT I* O r\ 

VSU 4.o0 


36 


36 


36 


VAD 5»70 


37 


37 


37 


ttwtt 0 ZTrx 
llMU j»O0 


38 


38 


38 


T\Tif ft 1 . /> / _ _ 

DIV 7*^0 (See 
Note 2) 


39 


39 




HMU 3.85 


ko 






DIV f.ko (See 
Note 2) 


kl 


41 


41 


VMU U.50 


k2 


42 


42 


DIV U.95 


k3 


43 


43 


VMU U.50 


kk 


1. It 
44 


44 


DIV U.95 


k5 


k5 


1 «— 

U5 


VMU U.50 


k6 


k6 


1*6 


DIV U.95 


1*7 


47 


ki 


VMU 


kQ 


U8 


k8 


DIV U.95 


■ k9 


1*9 


k9 


VMU U.90 


50 ■ 


50 


50 


DIV U.95 


51 


51 


51 


[None: See Note 3) 


52 


52 


• 52 


[None: See Note k) 


53 


53 


53 


None: See Note 3) 


> 


5k 


5k 



i". 



TAHJ3 (cont'd) 



Equivalence 
Class Mumber 



Problem Number 
Form X 



Problem Number 
Form W 



Problem Number 
MS AT 



(None; See Note k) 
(None: See Note 5) 
VMU 5.00 



55 
56 
57 
58 
59 
60 



55 
56 
57 
58 
59 
60 



55 
56 
57 
58 
59 
60 



(None: See Note 5) 
VMU 5.00 



(None: See Note 5) 



Notes: 



Note 1: Class definition is 19A + B «= **"»y vbere A + B > 9. 

Note 2: .Equations class If. 25. 

Npte,_3:„ Class definition is A X BCD = *-»*-. 

Note k: Class definition is ABC/D = iio remainder* - 

Note 5: Class definition is A/BCD A > B, no remainder* 



TABLE 5 



Characterization of SAT Problems t*y Math Strands Equivalence Class 

Inte mediate I 



Equivalence Problem Number Problem Number Problem Number 

Class Number Form X Foot W MS AT 



VAD 3.10 


1 


1 


1 


vsu 3.15 


2 


2 


2 


VAD 3.60 


3 


k 


3 


HAD 3.70 


k 


6 


k 


VMU 3.85 


5 


3 . 


5 


VMU 3.85 • 


6 


5 


6 


(None: See Note l) 


7 


8 


7 


vsu 4.15 


8 


7 ' 


8 


vsu 4.15 


9 


9 


9 


vsu 4.15 


10 


11 


10 


DIV lf.95 


11 


12 


11 


VMU 5.00 


12 


10 


12 


(None: See Note 2) 


13 


2k 


^ 


(None: See Note 3) 


Ik 


17 


Ik 


VAD 5.50 


15 


.13 


15 


VSU Iu90 


16 


19 


16 


VAD 5.90 


17 


■16 


17 


(None: See Note k) 


18 


18 


18 


VAD 5.10 


19 . 


15 


19 


(None:- See Note 5) 


20 


20 


20 


DIV 5<30 


21 


21 


21 


(None: See Note 6.) 


22 


22 


22 


VMU 5.00 


23 


2k 


23 


(None: See Note 5) 


2k 


25 


• 2k 


(None: See Note 6) 


25 


23 


25 


(None: See Note 7) 


26 


. 30 


26 
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TABLE 5 (cont'd) 



Equivalence Problem Number Problem Number Problem Number 
Class Number Form X Form W MSAT 



(None: See Note 6) 


27 


26 


. 27 


DIV 6.30 


28 


3* 


28 


DIV 5.50 


29 


29 


29 


DIV 5^50 


30 


33 


30 


(None: See Note 7) 


31 


31 


31 


VMU 6.00 


32 


32 


32 


DIV 5.50 


33 


33 


33 


DIV 5.35 


3^ 


3^ 


3* 


VMU 6.70 


35 


35 


35 


VMU 6.ko 


36 


- 37 


36 


(None: See Note 8) 


37 


36 


37 


(None: See Note 9) 


38 


38 


38 


VMU 6.60 


39 


39 


39 



Notes : 

Note 1: Class definition is AB + CD + E = 
B + D + E>9, A+C>9. 

Note 2: Class definition is A X BCD = A < 5. 

Note 3: VSU 5.20 with $ and decimal added. 

Note k; Class definition is ABC/D = no remainder. 

1ABCD 

Note -5: Class definition is - EFGH with borrows everywhere. 

Note 6: ' Class definition is !t l/A of BCD", no remainder. 

Note 7: Class definition is VBCDE where A divides BC and 

A divides DE. 
Note 8r VMU 6. 30 with $ and decimal added. - 
Note 9: FRA 5-60 '6±\\ "X". 
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TABLE 6 

Characterization of SAT Problems by Math Strands Equivalence Class 

Intermediate II 



Equivalence Problem Number Problem Number Problem Number 
Class Number Form X Form W MSAT 



(None: See Note l) 


1 


1 


1 


VAD 5.50 


2 


2 


2 


(None; See Note 2) 


3 


3 


3 


.. VAD, 5*70 


k 


k 


t 

k 


VAD 5.9O 


5 


11 


5 


(None: See Note 3) 


>* 

6 


6 


6 


(None: See Note 3) 


7 


5 


7 


VAD 5.70 


8 


12 


8 


DIV 5.50 


9 


13 


9 


DIV 5.50 


10 


9 


10 


VMU 6.30 


11 


8 


11 


VMU 6.U0 


12 


7 


12 


(None: See Note 3) 


13 


10 


13 


• ERA". U. '55 


ik 


16 


ik 


(None: See Note k) 


15 


17 


15 


DIV 6.60 


16 


18 


16 


VMJ 6,60 


17 


20 


17 


VMU 6.70 


18 


Ik 


18 


DIV 5.50 


19 


!9 


19 


DIV 6.50 


20 


15 


20 


DIV 6.60 


21 


21 


21 


FRA 6. hO 


22 


26 


22 


(None: See Note 5) 


23 


23. 


23 


(None: See Note 6) 


2k 


22 


2k 


FRA 5.60 


25 


2k 


25 


(None: See Note 7) 


26 


28 


26 



TABLE 6 (contM) 



Equivalence Problem Number 
Class Number Foim-X 


Problem Number 
Form W 


Problem Ni 
MSAT 


DEC 7.35 


27 


25 


27 


FRA 6. If 5 


28 . 


29 


28 


FRA 7.30 


29. 


30 


29 


(None: See Note 8) 


30 


33 


30 


(None: See Note 9) 


31 


31 


31 


FRA 6.85 


32 


32 


32 


MEA 5.10 


33 


29 


33 


(None: See Note 10) 


*3* 


. 35 


3^ 


(None:. See Note ll) 


35 


3k 


35 


(None: See Note 12) 


36 


36 


36 


(None: See Note 13) 


37 


39 


37 


(None: See Note Ik) 


38 


. 36 


38 


(None: See Note 15) 


39 


37 


39 



frotes : 

Note lj Class 'definition is VBCD where A < B and remainder = 0. 
Note 2: VSU 3*70 with $ and decimal added, 

.1ABCD 

Note 3: Class definition is - EFGH with borrows eveiyvhere. 

Note k: Class definition is "Find the average of A,B,C,D fl , average 
is an integer. 

A 

Note 5: Class definition is -D Ijj/F where A « D + 1, D may be 0, 
C(F) is a multiple of F(C) and B/C < E/F. 

A/B 

Note 6 1 Class definition is +1 C/D where B and D are relatively 
prime and A/B + C/D < 1. 

1AB ' x 

Note 7: Class definition is X C»D where C is 0 or 1. 
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TABLE 6 (cont'd) 

Note 8: Class definition is A/B = where A is a 3 or h digit number 

with 2 decimal places and B divides A. 
Note 9: Class definition is "Find the average of A,B,C" where A,B,C 

are measures. 

Note 10: Class definition is 2/A of B = where B is a measure* 

$AB.CD 

Note 11: Class definition is X EF • 

Note 12: DIV 6.40 with instruction "What is .the quotient rounded to 
tenths?" 

Note 13: Class definition is "A is what percent of B?" 
Note Ik: Class definition is A/*B = where B divides A* 
Note 15: Class definition is "What is A percent of B?" 
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Two of the wrong answers to- multiplication problems may be a pair 
of numbers that differ* from each other in one digit and are one digit 
too short. If there is a two digit multiplier, one of these short 
answers is constructed by using only one of the digits of the multiplier. 
Other possible wrong answers differ from the correct answer in any digit 
except the left-most one. Decimal. problems with numbers written with a 
dollar sign are treated as though they were integers. For most other 
decimal problems, either multiplication or division, the wrong answers 
differ from the correct answer in the placement of the decimal point. 
For these problems, four answers are chosen from 

CA * 10 K * -2 < K < 2 

where CA is the correct answer. 

Division problems occur in three fozmats: V§, B ~ A, and 1/A of B. 
For all three types the answer choices are constructed in the same way. 
Some choices have a remainder and others do not, regardless of the cor- 
rect answer remainder. The foimat used for presenting the answers change 
in the middle of the Intermediate II test. For Inteimediate I and the 
first part of Intermediate II, answer choices with remainders are written 
X, REM Y. For the second part of Inteimediate II, most of the choices 
are written X Y/Z. Wrong answers were constructed by changing one of the 
digits of the quotient, and for those answers with a remainder, choosing 
a random remainder. Some remainders were larger than the divisor. 

One dilemma was encountered in constructiag answers for division 
problems. Two problems on the X foim of Inteimediate I and one on the 
W form had two technically correct answers. The following item exem- 
plifies these problems. 

k/265 

A) h2 

B) 50, REM 8 

C) 52 

D) 5, REM 8 

E) NOT GIVEN 

C is the "correct" answer, but an argument can be made that B is also 
.correct. This answer choice was not imitated in constructing wrong 
answers for the MSAT. 

All of the items written for the MSAT are stored in the computer. 
A computer program constructs a pre- or post-test for a student by making 
a random selection among the three items written for each problem number. 
It is unlikely that two students will receive . the same test. A record is 
kept of the items that comprise each student f s test. 

It is anticipated that the MSAT parallels the SAT in nearly every 
aspect. The major exception concerns the possibility for students taking 



the paper and pencil SAT to return to problems already completed or 
skipped over. Students may skip any problem on the MSAT simply by typing 
the return key. However, once an MSAT problem is passed by a student 
there is no way for him to return to it. Some styles of responding ap- 
propriate for the SAT are inappropriate for the MSAT. 

Administration of the MSAT . Tests are administered at the terminal, 
preferably at one sitting. If a student is not able to work at the ter- 
' minal for a sufficiently long time to complete the test, it is continued 
at the next sign-on. The maximum time allowed to complete the test is 
the time allotted for administration of the computation section of the 
SAT, plus one-half the time it takes to type the test on the terminal. 

The response mode on the MSAT is as close as possible to that re- 
quired on the SAT. For multiple-choice items the student types a single 
letter, A, B, C, D or E. For constructed- responses the student woiks 
the problem as a regular strand problem, with the program error response 
suppressed. The student is allowed only one response to a problem. He 
may alter his response, using the rubout key. When he has completed his 
answer, he types the return key. If a student working a multiple -choice 
problem types a number instead of a letter, he is told to type a letter 
and given another chance. As soon as the return key is typed the program 
moves to the next problem. There is no time limit for individual problems* 
Many of the problems will require pencil and paper computation. 

The procedures that differ from the usual mode of responding at the 
• teletype must be explained to the student. A message at the beginning 
of each test mentions the following: 

1. using paper and pencil when necessary; 

2. answering multiple- choice questions with a letter (for the 
Intermediate I and II); 

3. using the return key after a response (for the Intermediate I 
and II); 

km using the return key to skip a problem; 

5. using the rubout key to erase; 

•6, understanding the time limit for the entire test. 

These six points and the printed instructions are explained and amplified 
by the CAI proctors before students take the MSAT. The instructions 
printed for the Primaiy II and the two intermediate foxms of the MSAT 
are displayed in Figure 1. As in the SAT, students. are given a non- 
graded sample problem before beginning the MSAT. Students are not given 
any results at the end of a test session. A coded number containing the 
score is printed at the end of the session for use by teachers. 
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Instructions for MSAT Primary II: 



MODIFIED S. A. T. STRAND 

THIS IS A SPECIAL TEST. YOU HAVE 33 MINUTES TO WORK 
ON IT. YOU MAY USE PENCIL AND PAPER. 

TYPE THE RETURN KEY TO GET THE NEXT PROBLEM. 

HERE IS A SAMPLE PROBLEM. 

k + 9 = _13__ 



Instructions for MSAT Intermediate I and Intermediate II: 



MODIFIED S. A. T. STRAND 

THIS IS A SPECIAL TEST. YOU HAVE 38 MINUTES TO WORK 
ON IT. USE PENCIL AND PAPER TO WORK THE PROBLEMS. 

ALL QUESTIONS ARE MULTIPLE CHOICE. TYPE A LETTER AND 
THEN THE RETURN KEY. USE THE RUBOUT KEY TO ERASE. USE 
THE RETURN KEY TO SKIP A PROBLEM. 

HERE IS A SAMPLE PROBLEM. 

k + 9 = 

A) 12 

B) 5 

C) 13 

D) 1*9 

E) NOT GIVEN 

C- 



Figure 1. Instructions printed for the Primary II 
and for the Intermediate forms of the 
Modified Stanford Achievement Test (MSAT). 
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Choice of level of test . Choice of the level of the MSAT to be 
administered to a student is made with reference to his average GP in 
the math strands curriculum. This choice algorithm is presented in 
Table 7. 

TABLE 7 

Choice Algorithm on MSAT Test Level 



Range of average GP on 
Test Level date of administration 

Primary II 2.0 - 3.5 

Intermediate I 3 # 6 - k.Q 

Intermediate IT. k*9 - 6.5 



Experiment I 

The purpose of the experiment was to measure the effect of varying 
numbers of math strands sessions on arithmetic computation grade place- 
ment (GP) measured by the strands curriculum and by the MSAT. Each 
student was allowed to take only a specified number of math sessions at 
the terminal. All other sign ons were spent working language arts lessons. 

Design . As many students as possible from among those who were taking 
both CAI math strands and CAT language arts, whose average GP on strands 
was between 2.k and 5.9, and who had taken at least 15 math strands ses- 
sions, participated in the experiment. The students selected were assigned 
at random to five experimental groups that differ in the maximum number of 
math strands sessions they permitted during the experimental period of 
approximately five months. 

Session limits were imposed on a calendar basis so that students with 
low numbers of sessions received them distributed throughout the experi- 
mental period. A participating student had no control over the type of 
lesson, math strands or language arts, he received. Whether he signed 
on for math strands or language arts a student was given a math strands 
lesson if he was eligible for one. Otherwise, he received a language 
arts lesson» 

Eligibility for a math strands session was decided according to the 
following algorithm • 
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If 

TS 

Ns i K c( fT * V * 23 ' where M i ^ TD i > 



was true, then student i received a math strands session, otherwise, he 
received a language arts session. In the algorithm, 

NS. is the number of sessions taken during the experimental 
period by student i, 

TS. is total number of sessions student i is to receive during 
the experimental period, 

TD* is number of calendar days in the experimental period for 
student i, 

D. is -number of calendar days student i has been in the 
experimental period, 

and the brackets denote the next greatest integer* Fpr example, suppose 
a student was in a 70 sessions group (TS^ s= 70) and the experimental period 

was 150 days (TD^ - 150) • If on the twenty-first day he was in the ex- 
periment = 21) he had taken 11 sessions (NSj^ 11), then he would 

receive a math strands session when he signed onto either math strands or 
language arts since 

TS 

11 = » t < Kflr * V + 23 18 [ <i5§ * 2i > + 23 w 12 • 



Some students signed on more than once a day in order to obtain the as- 
signed number of sessions* 

The actual number of math sessions a student received was monitored 
daily* The assistance of teachers and proctors was sought to help stu- 
dents achieve the number of math sessions they were assigned* Teachers 
were urged not to give ccmi>ensatoiy off-line work to students assigned 
to low numbers of on-line sessions, and, in general, not to alter the 
classroom work of any student because of his participation in the 
experiment* 

The MSAT was administered in January at the beginning of the experi- 
mental period and again in May immediately after the experiment ended* 

One-way, fixed-effects analysis of variance was used to test for 
overall' effect of treatment group* The model for this 1 analysis is 
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Y. . = u + a. + e. . 

where Y. . is post treatment score for student i in treatment 
1J group j, 

p. is overall mean, 

a. is effect of treatment group j , 

e is random error associated with student i in treatment j. 

Both Y. . and e. are assumed to be normally distributed, all treatment 

groups are assumed to have the same variance, and the errors associated 
with any pair of observations are assumed to be independent, i.u., 

E(e ij e ki ) = 0 E(e ij e kj ) = ° (IfeyS > 1963) - 

Additionally, it is important to investigate the relationship of 
posttreatment scores to pre treatment scores and the number of math strands 
sessions given. Five models of this relationship were tested. In all 
five models, denotes the pretreatment score of student i^ T i2 denotes 

the posttreatment score of student" i, and N. denotes number of math strands 
sessions taken by student i. 1 

Model I, Linear* 

E(T i2 ) - a Q + a lTil + a 2 N. . 

In this model, the effect of pretreatment score and number of ses- 
sions on posttreatment performance is assumed to be linear* 

Model II, Linear with interaction, 

E ( T i2> - *0 + a i T il + a 2 N i + a 3 T il N I * 



In Model II, a linear effect of pretreatment score and number of 
sessions is assumed, but a linear effect from the interaction of pre- 
treatment score and sessions is also postulated. 

Model III, Cobb-Douglas. 

E(in T i2 ) = a Q + a ± in + a p in N . 

Model III is based on a f emulation of the Cobb-Douglas type (from 
econometri.es), namely ^ 
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a i a 2 
T i2 - a O T il N i # 

This model is multiplicative and assumes n weighted interaction" in that 
a^ and indicate the relative importance of pretreatment score and 

number of sessions, respectively, in accounting for change in posttreatment 
scores. 

Model IV, Log quadratic. 

E(T i2 } = a 0 + a i T il + a 2 in N i + a 3 (in N i )2 + . a lf (in V 3 • 

In Model IV, the_ effect of the pretreatment score is assumed to be 
linear. The effect of number of sessions is assumed to be logarithmic, 
rather than linear. In order to explore this logarithmic assumption 
.fully, second- and third-order terms in in are included. 

Model V, Exponential. 

i2' 0 1 i il 

Model V is based on an exponential formulation, namely, 

a N.T.- 

T - a e 1 1 11 
T i2 " a 0 e 

In this model, the effect of number of sessions and pretreatment score 
may be strictly increasing or strictly decreasing, depending on the sign 
of a^. Pretreatment score and number of sessions are assumed to interact. 

Complete data were obtained for 312 students and the results -from 
Experiment I are discussed by Sunpes, Fletcher, Zanotti, Lorton, and 
Searle (1972). 

Experiment II 

The purpose of. Experiment II was to set a unique performance goal 
for each student and meet it by assigning the student more or fewer 
daily math strands sessions depending on his progress toward the goal. - 
In the current version of the experiment, students are assigned either 
one or two sessions daily for a two-week period. At the end of the 
period, the students* progress is re-evaluated and re-assignments of 
daily sessions are made where necessary. Goals are defined in terms of 
average grade placement (GP) on the math strands program. At the end 
of the experiment* average strands GP achieved by each student is com- 
pared with" his goal GP and with scores on external tests. 
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Design . Two performance goals were set for each student, one exter- 
nally derived and one internally derived. The external goal was based on 
the amount of arithmetic GP gain deaf students are expected to achieve 
during a school year. The Experiment II period of 16 weeks was about one- 
half a school year, and the external goal GP was defined as . 

XGP. = SGP. + (.5 * EGP.) 

where XGP ± is external goal GP for student i, 

SGP i is start of experiment GP for student i, 

EGP.. is expected gain in arithmetic GP on the SAT 

arithmetic computation subtest for the age group 
• of which student i is a member. 

Table 8 presents the expected change in arithmetic GP measured by the* 
SAT arithmetic computation subtest for the three SAT forms used in Ex- 
periment II. Which form was relevant for a particular student depends 
on the MSAT form assigned to him by the algorithm presented in Table 7. 
If EGP.. for student i was less, than .20, it was set to .20. 

The internal goal GP was more individualized than the external goal 
GP in that it was derived from students' performance histories* In setting 
internal performance goals, GP change per session was obtained for each 
student for his 20th to UOth session. His goal GP was then determined by 
extrapolation from a model of his progress with parameters generated from 
these initial observations. 

The six-week duration of Experiment II was divided into eight two- 
week periods starting on alternate Mondays. If pursued in the most 
straightforward manner, the experiment would assign all students to one 
session a day for the first two-week period, and, because of missed 
• sessions, the high level of the internal goal GP, etc., vould gradually 
assign more and more students to greater numbers of daily sessions in 
subsequent periods. The last experimental period might assign all stu- 
dents to the three daily sessions group. * This manner of assignment 
would undoubtedly exasperate the participating schools as well as exag- 
gerate whatever interaction might exist between number of daily sessions 
and rate of GP change. It was desirable, therefore, to extrapolate student 
progress over Experiment II with an adjustment for the probability that 
students would actually take an assigned session. 

The following model was calculated for each student from the 20th- 
UOth session observations: 

GP i = a i + b i s i c <§ (1) 
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TABLE 8 

Grade Placement Changes as Measured by Stanford Achievement Test 
Arithmetic Computation Sub-Test (Gentile and DiFrancesca, 1969) 



Primary II 

Age Gain 

10- U (gain)-:+ .66 

11- 22 (loss) - .15 

12- 13 (gain) + .28 

13- lU (gain) + .11 

Intermediate I 

Age Gain 

12- 13 (gain) + .35 

13- Ik (loss) - .02 
1U-15 (gain) + 
15-16 (loss) - .05 

Intermediate H 

Age Gain 
13-lU (gain) + .89 
1U-15 (gain) + .20 

15- 16 (gain) + .26 

16- 17 (loss) - .15 
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where GP i is average GP for student i, 

S.^ is number of sessions completed by student i. 

Extrapolation was accomplished by assigning a value to S.^ and solving 

for GPj. The value assigned -to~S^ yas either the number of school days 

in Experiment II or some function of that number. The probability that 
student i would take an assigned session was initially estimated from 
the 20th to **0th session observations: 



ED. 



x,s r s 2 



where P i( S ) is the estimated probability that student i will 

receive an assigned session, 

ED. ^ is the number of days student i was expected to . 

' b l~ 2 require to take session s^ to session s 2 inclusive. 

0D. .is the number of days student i required to 
1 > s l~ s 2 take sessions s.^ to Sg. 

P i (S) was called a probability only for simplicity of conception. 

Clearly, if student i received more sessions than were assigned to him, 
P i (S) would be greater than 1.0. Also, the variance of the P.(S) is 

greater than desirable; a student may miss two weeks because of illness 
and not miss another school day for the rest of the school year. For 
this reason the P i (S) were used only for assigning numbers of daily ses- 
sions to students and not for setting goal GP's. 

The number of sessions, required by student i to reach his goal 
GP calculated using S ± from the model (l) of his performance on strands 
was then adjusted by P^S). 

AS. = S ± + ((1-P;(S)) * B± ) . (3) 

where AS. is the number of sessions required by student i to 

1 reach his goal GP adjusted by the probability that 
he will receive an assigned session. 
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is the number of sessions student i is expected to 
take in the l6-week Experiment II period "(this value 
is also used in the performance model (l) to determine 
the goal GP for student i), 

P ± (S) is the "probability" student i will actually receive 
an assigned session. 

Number of sessions required daily of student i was defined as 

AS. 

Hs i - TE ■ W 

where NS^ is number of sessions required daily for student i, 

AS^ is adjusted total number of sessions required by 
student i, 

DL is number of days left in Experiment II. 

Number of daily sessions, T., actually assigned to student i was 
defined as 



r 1 if 0 < NS jL ^ 



< 1.0 1 



(5) 

2 otherwise 



The procedures indicated by (2), (3), (h)j and (5) were used for 
assigning students to one or two daily session treatment groups for the 
16 two-week periods in Experiment II. The P^S) were adjusted to include 

observations made during the experimental period as well as observations 
frail the 20th to kOth session interval. Subsequent S ± used for calcu- 
lating AS^ in (2) were the number ,of sessions students were expected to 
take in the time remaining for Experiment II. 

A report was generated on alternate Wednesday nights and made avail- 
able to the schools on the Thursday prior to the start of a new period. 
The Thursday report designated for the next period the assignment of 
Experiment II students to one of two groups , those who were to receive 
one or two math strands sessions daily, and the schools were expected to 
adjust the students 1 CAI schedule accordingly. The Thursday report, 
illustrated in Figure 2, contained the following information: 

1) Student number. 

2) Student name. 
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CLASS 303 MISS WALTER - 3D 20 APR 72 

6 STUDENTS — TEXAS SCHOOL FOR THE DEAF — GRADE 8 



NO. OF. 


TOTAL SES. AT 


GOAL 


ACTUAL 






SES/DAY 


END OF PERIOD 


CHANGE 


CHANGE 


NUMBER 


NAME 


2 


125 


.690 


.970 


826 j 


BARBARA DELGADO 


'i 


110 


.986 


.660 


828 


KENNETH GOMEZ 


2 


127 


1.150 


1.1*20 


830 


ROBERTA NESBTTT 


3 


112 


1.150 


.600 


833 


ALBERTO SANCHEZ 



h STUDENTS IN EXPERIMENT TWO 



Figure 2, Illustration of the Thursday report: New 
assignments of number of daily sessions 
for next Experiment II period. 
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3) Assignment of the student to the one or two daily sessions 
group. This assignment accorded with the definition of 
described above* 

k) Total number of sessions the student should have received at 
the end of the next period. 

RS i b CS + (CT i * 2) + (5^ * DP) 
where RS^ is number of sessions student i should have received 



at the end of the next period. 



CS i is current number of sessions student i has received, 

CT is number of sessions student i is currently receiving 

* daily (this value is multiplied by 2 to account for 
the fact that on Wednesday 2 days remain in the current 
period) , 

T is number of sessions student i is to receive daily 

* during the next period, 

DP is number of school days in the next two-week period. 

5) Goal change, the change in average GP tenths the student should 
have achieved to accord with the model of his perfonnance on 
strands used to deteimine his goal GP. 

GC i := (GP i - SGP^) * .10 

where GP. is grade placement for student i estimated under the 

assumptions and parameters used in (l), 

SGP^ is the start of experiment GP for student i. 

6) Actual change, the change in average GP 'tenths the student 
achieved during Experiment Ii. 

AQ ± = (CX3P i - SGP i ) * .10 

where AC^ is change in GP observed for student i, 

CGP i is current GP for student i, 
SG¥ ± is start of experiment GP for student i. 
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Data analysis . The proportion of students who reached the external ■ 
goal and the proportion who reached the internal goal were determined. 
The distribution of errors about the internal goal was also determined; 
i.e., the distribution of the 

(GP i - GGP i ) , 

where GPj^ is end of experiment grade placement for student i 

GGP ± is goal grade placement for student i, 

were determined. There was a good supply of students who undershot and 
overshot the internal goals. The mean, the variance, and the shape of* 
the error distribution were all of interest. 

An attempt was made to account for the trajectories of students 1 GP 
increases over time with a general rule. For simplicity of analysis 
these trajectories were assumed to be deterministic. A rule that accounts 
for all the individual trajectories, therefore, must be expressed in terms 
of rate of GP change, i.e., velocity, as 

dt Z V Z) 

where g = f (t) describes change in GP for student i as a function of 
time t; or In terms of rate of GP change, i.e., acceleration, as 

4 = f?(t) . . 

at x 

Five models of acceleration were examined. 
Model I. 

fj(t) = a. . 

Under Model I, acceleration is assumed to be constant for every 
student. 

Model II. 

f"i(t) = a it . 

Under Model II, acceleration is assumed to be a function of time. 
Also, acceleration at time zero (t » 0) is assumed to be zero, and the 
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student is assumed to be in a steady state with respect to GP change at 
the beginning of Experiment II. 



Model III. 



fj(t) = + a 2i t 



Under this model as under Model II, acceleration is assumed to be 
a function of time. However, at time zero, which is the beginning of 
Experiment II, acceleration is assumed to have some value different from 
zero. 

Model IV* - . 

apt 

fj(t) = a x e 2 . 

Under Model IV, acceleration is assumed to change exponentially as 
a function of time. As in Model III, acceleration is assumed to have 
a value other than zero at time zero. 

Model V# 

t\(t) = t * , a 2 < 1 . 

Under this model, acceleration is assumed to decrease monotonically 

a 

as a function of time. If a g « 0, then f£(t) = - -i and, simply, 
f ± (t) ea^nt + c. * 

During 1971-72 the biweekly predictions in the experiment were made 
in teitns of a linear model because the extensive analysis required to 
fit a more sophisticated model had not taken place. As reported in 
Suppes, Fletcher, and Zanotti (197 2 ) models of the following form pre- 
dicted student progress in Experiment II with a high degree of precision: 

GP i = a i * b i S i > 0 ^ 1 ' 

where GP^ is the grade placement of student i, 

S is number of sessions taken by student i, 

and b^ are unique parameters of the model calculated for 
student i. 
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The two instances from this family of models used by Suppes, Fletcher, 
and Zanotti are the following 

° p i s a i + b i s Y 3 ■ (1) 

G? ± = a ± + b ± in(S jL ) (2) 

A graph of the first model with c « 1/3* the second logarithmic model, 
and progress actually observed for one student during the 1971-72 run of 
Experiment II is shown in Figure 3» Two aspects of these models are to 
be noted. First, they predict negative GP for low numbers of sessions; 
the exponential model (l) with c « 1/3 crosses the sessions axis (abscissa) 
between 0 and 1 sessions, and the logarithmic model (2) crosses the ses- 
sions axis between h and 5 sessions ♦ The concept of negative GP is at 
least undefined and probably nonsensical* Second, it is not clear how 
to treat second, third, etc. year start-ups for a student whose progress 
has been observed and modeled before. The models used predict a scalloping 
effect if each year f s progress is observed separately from progress in 
other years; i.e., in each year we would' expect rapid initial progress 
that very gradually tapers off as the year wears on. If each new year , s 
progress is treated as an extension of the previous year (i»e., the new 
sessions are simply added on to the previous total sessions), we can 
expect some imprecision to develop in the model. 

For all the accuracy of the models in tte 30-130 session range, we 
anticipate serious difficulties in predicting student progress for very 
small and very large numbers of sessions. Using the 1972-73 student 
data, we expect to make headway in solving these problems. 

We do take it that the most important thrust of the evaluation of 
the mathematics curriculum will be the attempt in 1972-73 to build more 
adequate individualized models* of student progress through the curriculum. 
If we can achieve at a reasonable level the objectives we have set of 
building a model with individual parameters for individual students, we 
believe that we will have taken a. considerable step forward. in being able 
to predict the progress of individual students. Our understanding of 
individual student progress will be superior to anything that is cur- 
rently available either in computer-assisted instruction or in ordinary 
instruction. 

Experiment III 

Comparisons of the achievement measures used in this study with each 
other and- with standardized tests are of natural interest. Generally, 
when an educator speaks of grade placement he has a standardized test in 
.mind. Because neither the MS AT nor GP measured by the strands curriculum 
is a common measure, it was decided to estimate the concurrent validity 
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Figure 3. Graph of two models of predicted student progress and the 

progress actually- observed for one student in the mathematics 
strands curriculum during 1971-72. The dashed line represents 
the exponential model: 

1/3 

OP « - .573 ♦ X»0«i2 S' VJ > where S is number of sessions taken. 

The solid line represents the logarithmic model: 

0P- - 2.203 t l.^Cfc in(S) . 

The solid circles represent the progress actually observed 
for the student.. 
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of the MSAT GP and strands average GP by comparing then/ with each other 
and with paper and pencil administrations of the^SAJ!^ 



Design * Sixty subjects were drawn at random from among all subjects 
in three of the participating residential schools. Selection of the sub- 
jects was stratified so that four were chosen for each of the 15 MSAT 
form (Primary II, Intermediate I, Intermediate II) by treatment group 
(10, 1*0, 70, 100, 130 sessions) cells. Two of the four subjects were 
chosen at random and assigned to Group I; the remaining two were assigned 
to Group II. There were then 30 subjects (two from each form by treatment 
cell times 15 cells) assigned to Group I and 30 assigned to Group II. 
Group I received paper and pencil administration of the SAT Arithmetic 
Computation Subtest (SAT-0OMP), Form W, before receiving the pretreatrnent 
MSAT, and Group II received the SAT-C0MP after receiving the pretreatrnent 
MSAT. The roles of Group I and Group II- were reversed for the post- 
treatment measure. Group II received the SAT-00MP before the posttreatment 
MSAT, and Group I received the SAT-00MP after the posttreatment MSAT. Pre- 
and posttreatment strands GP scores were also recorded for all the subjects. 

Complete data were obtained for kk of these subjects. The loss of 
16 subjects was solely due to such random factors as student illness, 
change of schools, administration errors. Means and "standard deviations 
obtained by the kk subjects for pre- and posttreatment SAT GP, MSAT GP, 
and strands GP are displayed in Table 9. It should be noted from Table 9 
that the SAT consistently gives the highest estimate of GP for this group 
of students, the MSAT consistently gives the second highest GP estimate, 
and the strands GP consistently gives the lowest GP estimate. In other 
words, both the MSAT and the strands average GP measures underestimate 
GP measured by paper and pencil administration of the SAT. 

A matrix of simple correlations for the GP scores obtained by the 1*1* 
subjects on pre- and posttreatment SAT, MSAT, and math strands is given 
in Table 10. These correlations are fairly large, but they are not suf- 
ficiently large to identify SAT GP, MSAT GP, and strands GP as parallel 
measures. According to Lord and Novick (1968), two distinct measurements 
X ga and *ha are P aralle:L if for eve *y subject, a, in the population, 
*ga ~ *ha and °^ E ga^ ~ ^ E ha^ wkere * indicates measurements with the 
same true scores but possibly different error variances. .More intuitively, 
two measurements are parallel if their expectations are equivalent and 
their observed score variances are equal. This is not true of the three 
GP measures. 

The correlations of posttreatment SAT GP with posttreatment MSAT GP 
and of posttreatment SAT GP with post-treatment strands GP would be higher 
if the modeled relationships were not curved. Examination of the scatter 
plots obtained from the kk students 1 GP scores indicates a linear relation 
between the lower SAT GP scores and the lover MSAT GP scores and between 
the lower SAT GP scores and the lower strands GP scores, but for higher 
GP scores the tendency for both MSAT GP and strands GP to underestimate 
SAT GP gradually increases. 
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A more complete discussion of Experiment III is given by Suppes, 
Fletcher, Zanotti, Lorton, and Searle (1972). 

Conclusions 

As reported by Suppes, Fletcher, Zanotti, Lorton, and Searle (1972), 
analysis of variance indicated a significant effect (F = 9.088; df « h,30J; 
p < .01) for number of math strands CAI sessions on the average GP measured 
by the strands program and a nonsignificant effect (F = l*k6k} df = **,307) 
for number of sessions on MS AT GP- In both the W-subject sample* and the 
: ill 312-subject population, MSAT GP appeared less sensitive to different 
numbers of CAE sessions than did strands average GP* In the 312-subject 
population the correlation for number of sessions taken and MSAT GP was 
•155 compared with *kl6 for number of sessions and strands ^P, 

Means and standard deviations for GP change (posttreatment GP minus 
pretreatment GP) obtained by the five treatment groups are displayed in 
Table 11. With the exception of average GP change for Group 3, a fairly 
steady increase in GP change with increasing number of sessions is evi- 
dent in the data. It should be noted that the GP change for Group 5 whose 
members averaged 75«8** sessions is .96 for strands average GP and .76 for 
MSAT GP# Both of these measures underestimated GP measured by paper and 
pencil administration of the SAT to the Ut-subject sample. In the worst 
case, the Group 5 students achieved an increase in mathematics confutation 
GP of .76 during the experimental period of approximately five months. 
This improvement is about double the GP gain indicated by Gentile and 
DiFrancesca (1969) for hearing-impaired students after an entire school 
year of traditional classroom instruction. 

That we can expect "a fairly dramatic improvement in mathematics com- 
putation GP is supported by an examination of the models of student 
achievement. The simple, linear model of achievement, measured by strands 
average GP, as a function of pretreatment GP (T ) and nunber of sessions 
taken (M.) is, from Suppes, et al. 9 x 

T i2 = .305 ♦ .930 T i± * .012 N. , 

where T_ 2 is the posttreatment strands GP. This model accounts for 91 

percent of the variance in the posttreatment distribution of GP scores 
and projects an improvement of 1.1*8 in GP over a school year assuming 
120 sessions, or less than one 10-minute CAE session per school day. 
This improvement is about four times what the Gentile and DiFrancesca 
(1969) survey indicates for hearing-impaired students, and we iterate 
that this improvement underestimated GP measured by paper and pencil 
administrations of the SAT. 

The ability of the simple, linear model of student achievement to 
account for posttreatment distribution GP measured by the MSAT and by the 
strands curriculum is worth noting. Very litxle improvement in accounting 
for posttreatment GF variance is achieved by the addition of interaction 
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TABLE 11 

Sample Size, Mean, and Standard Deviation of GP Change 
(Post treatment GP Minus Pretreatment GP) 
Measured by Strands Average GP and MSAT 
GP for the Five Treatment Groups - 





Treatment group 


1 


2 


3 


k 


5 




Sample size 


60 


62 


60 


60 


70 


Strands A GP 


Mean 


.15 


M 


.6k 


.91 


.96 


Standard deviation 






.01 


.03 


•03 


.05 


.05 


MSAT A GP 


Mean 


,k2 


.58 


.48 


.68 


.76 


Standard deviation 








.10 


•09 


.08 


.10 


.11 
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teims to these models. Greater numbers of CAI sessions seem to be equally 
beneficial for all students , across all levels of pretreatment ability. 
The inequality averting properties of the math strands curriculum used as 
compensatory education for hearing students has already been noted by 
Jamison, Fletcher, Suppes, and Atkinson (1972). These properties seem 
to obtain equally well for the population of hearing- impaired students 
used in this study. 

We conclude, then, that the mathematics strands CAI curriculum can 
achieve fairly dramatic increases in mathematics computation GP and, 
concomitantly, in computation ability when used by he a ring- impaired stu- 
dents. Further, these increases occur equally across all levels of 
ability. That students enjoy CAI, that it provides immediate knowledge 
of results, that it is absolutely impartial in evaluating student responses, 
and that its benefits are easily replicable independent of the enthusiasm 
and ability of educators typically associated with pilot projects have all 
been noted and emphasized elsewhere. The studies reported here indicate 
the impact CAI can have when properly applied in a large-scale project • 

Language Arts Curriculum for Hearing Impaired Students 
Introduction 

The effort in the Language Arts program has been to develop a com- 
puter-assisted instruction (CAI) curriculum in standard English usage 
and a related paper and pencil test for students between the ages of 12 
and 16 enrolled in special schools or classes for the deaf and hard of 
hearing. Rawlings 1 survey (l97l) indicates that 7^ percent of the stu- 
dents in these schools and classes have suffered a hearing loss of 60 
decibels or more in the better ear. Mean, grade placement (GP) reading 
levels measured by the Stanford Achievement Test (SAT) for hearing 
impaired students 12 to 16 years of age are given in Table 12. 

A vocabulary list was generated for the curriculum by taking the 
words common to the third-grade vocabulary lists of four widely used 
basal readers: Scott-Foresman (1962), Lippincott ; (196!+), Ginn (1966), 
and Macmillan (1966). Although words not found in this list are occa- 
sionally used in the Language Arts course, an attempt was made to restrict 
the vocabulary to this list. The list is given in Appendix A. A 
Dictionary of Idioms for the Deaf (Boatner and Gates, 1966) was also 
consulted in determining the vocabulary for the course. Teachers in the 
participating schools emphasized that idioms are confusing to their 
students , and an attempt was. made to avoid idiomatic constructions in 
the course. 

Most language curriculums in schools and classes for the hearing 
impaired are based on the Fitzgerald Key (Fitzgerald, 19^9). This sys- 
tem classifies all words and phrases into categories identified by such 
words as "who, 11 "what, 11 "where," and "when." Deaf students are taught 
standard English usage by identifying the Fitzgerald category to which 
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TABLE 12 



Total Reading Grade Equivalencies for Students with a 
Hearing Loss Threshold of 60 Decibels and Above 
(Gentile and DiFrancesca, 1969) 





12 


13 


lU 


15 


16 


Primary II 


2.1*1 


2.51 


2.UU 






Intermediate I 


3.^1 


3.1*6 


3.33 


3.33 


3.35 


Intermediate II 




3.97 


1*. 31 


k.2k 


• It. 17 
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words in question belong. The teacher is to focus on words suggested by 
objects in the room or experiences of the students. Because this method 
depends heavily on classroom experiences and because consultants called 
in to aid in the design of the curriculum recommended a fresh approach, 
the Fitzgerald Key is used only sparingly in the CLAI curriculum. 

The basic problem in teaching English to hearing impaired students 
is that they have little or no aural language on which to build. Unlike 
a hearing student, the hearing impaired student is unlikely to have in- 
ternalized much English syntax, inflection, or vocabulary before he 
starts school. Rawlings 1 survey (1971) indicates that 75 percent of 
students in special classes for the hearing impaired experienced hearing 
loss before age three. There is a real possibility that the deaf child 
can never assimilate the, basic principles of English that a hearing child 
acquires at an early age (Lennebeig, 1967). For a deaf child, learning 
to read is more than a grapheme to phoneme decoding task; it is actually 
learning a language from its written form. Learning to write standard 
English is similarly complicated for a deaf student. 

The language difficulties of hearing impaired students were carefully 
considered in developing the Language* Arts curriculum. The curriculum 
was designed to stress the structure of English, with particular emphasis 
on the roles of syntax and inflection and on the meaning of function words. 
Later, the teaching strategy of the course will be discussed in more detail, 
but there are some ways in which that strategy partially determines the 
content of the course. An inductive rather than a deductive strategy is 
used. Therefore, the grammar course does not explicitly state "rules 11 of 
English usage, but instead presents items illustrating aspects of standard 
English usage singly and in combination. Incidental learning of basic 
sentence patterns is enhanced by presenting curricu3:um items in complete 
sentences. Fewer than one-tenth of the exercises present the student with 
single words or isolated phrases. Incidental learning is also enhanced 
by requiring many constructed ratter than multiple-choice responses. 

The course is not intended to be a complete course in English. 
Classroom instruction remains the largest portion of the students lan- 
guage experience, while the CAI course provides supplementary, individ- 
ualized drill. The classroom schedule of instruction need not be altered 
to adapt to the sequence of instruction in the CAI course, although paper- 
and-pencil drill given in the classroom can be reduced. No specific 
instruction in standard English usage is needed before students begin 
this course. 

Description of the Language Arts Curriculum 

The curriculum is divided into 2l8 lessons of 20-30 exercises. It 
is designed to provide a student for whan the course is intended with 
10 minutes of daily drill and practice for an entire school year. An 
outline of the course is included as Appendix B. Separate topics are 
presented in separate lessons and often there is a sequence of lessons 
on a single topic. The lessons are ordered to provide a cumulative basis 
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of concepts building upon one another. Several lessons are intended to 
review topics presented in preceding lessons. 

If a lesson introduces a new topic, carefully sequenced explanation 
and instruction are given in a short "tutorial" section at the beginning 
of the lesson. In subsequent lessons on the same subject, short but 
complete instructions are given. The inclusion of this tutorial instruc- 
tion allows students to proceed through the course at their own pace, 
without waiting for group instruction on each new topic. 

To provide for further individualization of instruction, each lesson 
contains one or more "checkpoints." At these points the student's, per- 
formance on the lesson is graded, and a decision is made to give him 
more practice or allow him to skip to the next lesson. This checking is 
done automatically by the computer program and usually occurs after the 
sixth or seventh exercise in the lesson. In most cases th~ student must 
achieve a fairly high performance ,1«jvel, for example, 85 percent correct 
or better, before he is allowed to skip the lesson. 

The order in which the lessons are given in the outline is the order 
in which most students encounter them. The lessons are interrelated in 
that concepts introduced in earlier lessons are used to explain concepts 
introduced in later lessons. However, lessons can be taken out of 
sequence. Each lesson is self-contained in that the task is completely 
explained and, except for the mixed drill lessons, each lesson focuses 
on a specifically defined task. A teacher can easily alter th< :>rder in 
which the students encounter lessons to conform mox closely wxth the 
development of classroom work, or to provide certain students with review 
lessons on a specific topic. 

Suggestions for the curriculum content came from many sources. One 
of the most important of these was the Kendall School for the Deaf in 
Washington, D.C. Stanford and Kendall staff members worked together 
during t.he spring and summer of 1970 to develop programmed lessons in 
English usage for students at the school. This was part of a larger 
Kendall plan to develop curriculum material in transformational grammar 
for deaf students. To some extent, the content of the Language Arts 
Course was determined by this early cooperation; many parts of the cur- 
rent curriculum reflect an orientation toward transformational grairimar, 
though more traditional approaches to teaching standard usage are also 
included. Many helpful ideas were drawn from The Roberts English Series 
(Roberts, Ross, and Boyd, 1970), and the workbooks for the series fur- 
nished examples for specific items. 

In addition, teachers from the schools whose students used the course 
have been encouraged to contribute ideas and criticism. In some cases, 
these suggestions have resulted directly in the writing of a series of 
lessons; these comments on early lessons provided a helpful framework 
for planning and writing subsequent lessons. 
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Finally, samples of written work by students at Kendall School and 
California School for the Deaf at Berkeley were studied to indicate pro- 
blem areas peculiar to deaf students. Neither the volume nor the breadth 
of this early corpus was sufficient to justify detailed statistical study; 
however, the nature of the errors observed in the students 1 work confirmed 
previous tentative conclusions regarding course content. Further samples 
of spontaneous written language of deaf students have been gathered from 
the schools and from the TAIK program developed at B4SSS. These samples 
are now being more thoroughly analyzed. 

Terminology used in the Language Arts Course reflects the blend of 
transformational and traditional approaches mentioned above. To some 
extent, it uses the terminology found in the Roberts series through the 
kth grade, and these terms _are not substantially different from those 
used in other curriculums reviewed by the Stanford staff. Some greater 
degree of precision is afforded by use of the Roberts terms in a few 
cases; e.g., the common term "auxiliary" is not used because understanding 
the function of elements commonly called auxiliaries in the phrases pre- 
sented by the curriculum requires a set of more precise terms, so, for 
instance, the term "modal" is used to identify constituents such as can, 
may , will, etc. In addition to terms taken from other language curriculums, 
some labels were invented specifically for the Language Arts Course to keep 
the terminology as short and clear as possible. Thus, for- example ^ "ing- 
form" is used instead of "present participle," "have-word" for "form of 
the verb have ," "not-sentence" for "negative sentence." 

An underlying goal of the Language Arts Course is to focus attention 
on groups of words performing a single function, rather than on individual 
words alone. This goal explains the great emphasis on noun, prepositions, 
and verb phrases; all work on specific constituents of these phrases leads 
directly to work involving the group of words functioning in the sentence. 
Emphasis is afJLso given to agreement between parts of phrases and agreement 
between parts of the sentence. 

Course objectives . There are four general course objectives. 
Students are tot 

(1) Recognize specified grammatical categories; 

(2) Recognize and supply various forms of given grammatical 
structures; 

(3) Select appropriate grammatical units to complete a specified 
structure; and 

(k) Perform specified transformations on grammatical structures. 

Under objective (l) the following parts of speech and grammatical 
structures are explicitly identified: noun, determiner, noun phrase, 
verb, adjective, subject, predicate, pronoun, modal, vowel, preposition, 
prepositional phrase, and contraction. The student should be able to 
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recognize the structure and identify the structure in a sentence. The 
specific tasks are: 



(a 
(b 

(c 

(a 



(e 
« 
(g 
(h 

(i 

(J 
(k 



Identify one or more nouns, in either a nominative or objective 
position. 

Identify one or more of the following as determiners "a, 11 "/in," 
"the," "some, 11 "every," "no," "all," cardinal numbers from "one 
to "ten," and double determiners with "all" or cardinals. 

Identify isolated vowels, and select from a group of words the 
one that starts with a vowel. 

Identify noun phrases (appearing in either a nominative or 
objective position) of the following types: single noun or pro- 
noun, determiner-noun, deteiminer-adjective-noun, deteiminer- 
deteiminer-noun, adjective-noun, detenniner-adjective-adjective- 
noun. Noun phrases are ordinally specified, specified as sin- 
gular or plural, or specified as possessive. 

Select from a given sentence one or more nouns specified as 
singular or plural. 

Identify verbs in the simple present, present progressive, 
simple past, past progressive, modal fom, or "be-word" fona. 

Identify from a -given sentence one or more nominative or pred- 
icate adjectives. 

Identify the complete subject (either simple or compound) and 
the complete predicate of a given sentence and indicate whether 
the subject is singular or plural. 

Identify as pronouns: "he," "she," "it," "they," "I," "you," 
"we," "me," "him," "her," "us," and "them"; and as possessive 
pronouns: "my," "his," "her/ 



Identify as prepositions: "in, 
"on 11 " a+ " l,VrtF 11 " 



'its," "your," "our," and "their." 
'to," "of," "for," "with," 



(1) 



at," "by," "from," "after," "into," "over," "before." 



Identify prepositional phrases of th* following types: 
preposition-noun, preposition-detemLner-noun, preposition- 
adjective-noun, preposition-deteminer-adjective-noun. Pre- 
positional phrases are ordinally specified or specified as a 
phrase that tells "where" or "when." 

Identify contractions with foims of "be" and negative contrac- 
tions with foims of "have," "be," and "do." 
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(m) Given a declarative sentence and a related question, identify 
the nominative or objective noun phrase or the prepositional 
phrase that answers the question. 

Under objective (2) the student should be able to: 

(a) Supply the plurals of given singular nouns, and the singulars 
of given plural nouns, both regular and irregular. Regular 
nouns include those whose plurals are formed by adding -s, 
- es > (y)~ ies > or (f)-ves. Irregular nouns given are: "man, 11 
"woman," "child," "foot," "mouse," "sheep," "deer," "aspirin," 
and "offspring," 

(b) , Indicate whether a specified noun phrase is singular or plural, 

(c) Given the root form of a verb, supply the gender marked form 
(third person singular), simple past, or present participle. 
Verbs given are regular (including those ending with single 
consonants and -y) and the irregular verbs "have," "go," and 
"do" in the third person singular and past forms. 

Under objective (3) the student should be able to: 

(a) Type "a" or "an" before a given noun in a sentence, depending 
on the first letter of the noun; 

(b) Choose from two given determiners the one that agrees in number 
with a given singular or plural noun in a sentence, 

(c) Choose from two given pronouns the one that is appropriate 
either in number or gender x>r case or all three for the noun 
phrase that it will replace, 

(d) Choose among given prepositions the one that is appropriate to 
complete a sentence, or given a parallel sentence, type the 
correct preposition to complete a sentence, 

(e) Choose the correct inflection of a verb based on subject-verb 
agreement in number, 

(f) Choose the correct noun form or pronoun based on subject-verb 
agreement in number, 

(g) Given the root form of a verb, construct the correct form of 
the present progressive to complete a sentence. 

Under objective (k) the student should be able to: 

(a) Combine two related sentences into one by specifying the 
position of an adjective to be inserted. 
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(b) Indicate the negative transfoim of a given sentence (including 
a modal, a fozro of "have/ 1 or a forai of "be 1 ') by specifying 
the position of "not." 

(c) Indicate the question transfomi of a sentence by choosing the 
modal, have-word, or be-word that changes position. 

(d) Construct a possessive noun phrase from a sentence of the foim: 
noun phrase, foim of "have," noun phrase. 

(e) Make a contraction of "be" and a pronoun or noun phrase. 

(f) Expand a contraction with "be" and a pronoun or noun phrase. ' 

(g) Make a negative contraction of "be," "have," or "do. 11 

(h) Expand a negative contraction of "be,," "have," or "do." 

The course begins with 10 introductory lessons* The first lesson 
familiarizes the student with the teletype with specific attention to 
potential sources of confusion such as the number 1 and the letter I, 
and the number zero and the letter 0. The nine "directions" lessons 
which follow the first introductory lesson serve two purposes: (l) they 
provide material requested in early consultations by some teachers of 
deaf students .> and (2) they familiarize the student furtlier with the dif- 
ferent kinds of instructions he will encounter later throughout the course 
These lessons are parallel to, but not as extensive as, The Language of 
directions by Mary Lou Rush (197O). 

The specific objectives of the directions lessons are that students 
should be able to do the following: 

(a) Type any letter or letters in a given word identified by one 
of the following: ordinals ("first" through "fourth"), "after 
the first," "first two," "last," "before the last," "last two." 

(b) !fype any word or words in a given sentence identified by one 
of the following: ordinals ("first 11 through "fourth"), "after" 
or "before" a given word, "before the last." 

(c) Copy on the teletype a two- or three-word phrase from a given 
sentence-, including the space between words. 

(d) Given two or three rows of numbers (each row containing up to 
five numbers), type any number whose position is specified by 
"above," "below," or "under" another number. . 

Exercise tasks . Each exercise or curriculum item involves three 
steps : read the instructions or have them in mind when instructions for 
similar exercises have not been repeated; determine the answer; type the 
answer. One categorization of the exercise tasks accords with the first 
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step, reading or remembering the instructions. Under this scheme there 
are four basic exercise tasks, the last two of which are simple variants 
of the first two. 

The first of these tasks is labeled recognition. In this task, the 
correct response is printed somewhere in the exercise display that is 
given to the student before he is required to respond. If the student 
can recognize the correct answer, he need only copy it. The following 
are two examples of this task: 

// TYPE THE NOUN. 

The dog is sleeping. 

// TYPE "A" OR "AN. " 

An airplane has — - engine. 

The second of these exercise tasks is labeled construction. These 
tasks require the construction of a word or phrase not printed in the 
exercise display. Two examples of construction tasks are the following: 

// TYPE THE NOUN. 

Woman 

// MAKE A POSSESSIVE NOUN PHRASE. 
They have a football. 

The third and fourth exercise tasks are labeled recognition without 
instruction and cons traction without instruction. They differ from the 
first two tasks only in that the instructions for them are not printed 
in the exercise display. They occur in lessens in which all the exer- 
cises require equivalent instructions. In general, the instructions are 
not repeated after the third or fourth exercise in these lessons. 

A second categorization of the exercise tasks expands the first 
four-member categorization scheme into 19 members. This second cate- 
gorization has more cognitive overtones than the first, but, still, it 
is unambiguously based on the instructions given to the students. There 
are four dimensions of this categorization: 

(a) Instructions given or no instructions given. As before, this 
dimension distinguishes exercises that occur early for which 
the instructions are printed or repeated, from exercises that 
occur later in lessons when it can be assumed the student has 
them well in mind and they do not require repetition. 



(b) Instance (number) or instance (text) or concept. This dimen- 
sion distinguishes exercises in which the student must answer 
with an instance of a concept from exercises in which the 
student must answer with a concept based on a given instance. 
When concepts are to be given as answers they are always abbre- 
viated. The instances may be numbered so the student need- reply 
only with the number(s) associated with the text of the instance- 
instance (number)— rather than having to type the actual text of 
the instances— instance (text). 

(c) Recognition or construction (explicit basis) or construction 
(implicit basis). As in the first categorization of exercise 
tasks, this dimension distinguishes exercises in which the 
answer is printed in the exercise display— recognition— from 
exercises in which the answer does not appear in the display- 
construction. The construction (explicit basis) and construction 
(implicit basis) dimensions distinguish between degrees of ex- 
plicitness in the exercise directions. In construction (explicit 
basis) a fonn, but not the correct foim, of the correct answer 
text is given; in construction (implicit basis) no foxro of the 
correct answer is given explicitly. 

(d) Usage or definition. This dimension distinguishes exercises in 
which the answer is to be derived on the basis of an implicit 
rule of usage taught inductively in the curriculum from exercises 
in which the answer is to be derived from the definition of a 
grammatical category. 

Given 2 times 3 times 3 times 2 possibilities, there would be 36 
categories under this task classification scheme if it were not for the 
following combinations that do not occur: 



there are np concept - construction tasks; 
there are no concept - usage tasks; 

and there are no instance (number) - construction tasks. 

Eighteen categories are left plus one category labeled ''Giveaway. 11 The 
Giveaway category and nine of the 18 categories with one example for 
each follow. The nine excluded categories are simply those from the no 
instruction dimension, i.e., the categories not listed and exemplified 
would be exactly the same as those listed except the instructions would 
be withheld. 

(1) Instance (number) - recognition - usage. 

// WHERE DCJ?S THE ADJECTIVE GO? 

// TYPE A NUMBER. 
The ten men lifted weights. 
123I+5 6 
(The men were strong.) 
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(2) Instance (number) - recognition - definition* 
// TYPE THE NUMBERS UNDER THE SUBJECT* 

Some little boys can swim fast* 
1 2 3^56 

(3) Instance (text) - recognition - usage* 

// TYPE "IT" OR "THEY" TO COMPLETE THE SENTENCE. 
The little apples were sour. 
— were sour. 
(h) instance (text) - recognition - definition. 
// TYPE THE NOUN. 
Our school is new. 

(5) Instance (text) - construction (implicit basis) - usage. 
// COMPLETE THE SECOND SENTENCE. 

Ify sister goes downtown for the parade. 
The babies «— downtown with her. 

(6) Instance (text) - construction (implicit basis) - definition. 
// MAKE A POSSESSIVE NOUN PHRASE. 

The boy has a dog. 

(7) Instance (text) - construction (explicit basis) - usage. 
// TYPE THE PRESENT PROGRESSIVE OF "COCK." 

' Tonight my father for us. 

(8) Instance (text) - construction (explicit basis) - definition. 
// TYPE THE PLURAL. 

• Wife 

(9) Concept - recognition - definition. 
// TYPE !, NP ff OR "ADJ" OR "V. n 
Some bicycles were red . 



(10) Giveaway, 

// CHANGE THE NEGATIVE CONTRACTION* 
The apple isn't ripe yet, 
// YOU SHOULD TYPE "IS NOT, 11 

A third categorization of the exercise task is based solely on the 
foimat of the correct answer, The two uimensions of this categorization 
are the following. 

a) Word or letter or number or abbreviation. There" is some "nesting" 
under this dimension: word is subclassified as 1, 2, 3, or k word 
strings; letter is classified as 1, '2, or 3 letter strings; and 
number is classified as 1, 2, 3, 4, or 5 number strings. Abbre- 
viations present a problem in that they could reasonably be 
classified as single letters, multiple letters, or single words. 
It was decided that they would confuse the single letter, mul- 
tiple letter, or single word results, and they will be treated 
separately in the exercise task data analyses. 

b) Sequence or no sequence. In some instances, the sequence of a 
multiple word, multiple letter, or multiple number response is 
important; in some instances sequence is not important. This 
dimension is intended to distinguish between these instances. 

The 17 tasks under this third categorization scheme that actually 
occur in the curriculum are the following. 



(1) 


Single word. 


'(2) 


Two words - no sequence. 


(3) 


Three words - no sequence. 


(h) 


Single letter. 


(5) 


Two letters - no sequence. 


(6) 


Three letters - no sequence. 


(7) 


Single number. 


(8) 


Two numbers - no sequence. 


(9) 


Three numbers - no sequence. 


(10) 


Abbreviation. 


(11) 


Two words sequence. 


(12) 


Three words - sequence. 


(13) 


Four words - sequence 
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(15) 
(16) 
(17) 



Two numbers - sequence. 
Three numbers - sequence. 
Four numbers - sequence. 
Five numbers - sequence. 



All exercises in the curriculum have been labeled with respect to 
each of the three exercise task categorization procedures. In the 
evaluation of the curriculum, comparisons among categories and stepwise 
multivariate regression will be used to determine if the difficulty of 
an item is to sane significant extent attributable to the exercise task 
it represents. 

Teaching strategies . It is important in any discussion of CAI to 
understand the freedoms and limitations of the medium. One feature 
common to all IMSSS CAE courses is some individualization in the sequence 
and content of the instruction. Curriculum is generally aimed at satis- 
fying a range of student needs and student abilities. CAI allows for 
individualized instruction by tailoring curriculums for each student on 
the basis of his response history. Further, CAI allows each student to 
work alone in an environment which need not be as competitive, threatening, 
or judgmental as the classroom. 

IMSSS CAI curriculums do not depend on the presence of a knowledge- 
able teacher to help the student work at the computer terminal. The 
courses are self-contained, and must supply as many appropriate explan- 
ations and alternative examples as possible. 

The Language Arts Course is a unique curriculum. Though" its content 
is not remarkably different from other language study courses for hearing 
impaired students, its method is by necessity significantly different. 
Its design includes: (l) consistency of format, (2^ unambiguity of 
"correct" answers, (3) specific correction messages appropriate to in- 
correct responses, (h) internal data collection, (5) branching around 
blocks of material for more able students, and' (6) choice mechanism, 
allowing a variety of lessons. 

Formats of instruc ions are consistent and unambiguous. The student 
is always allowed the options of having the problem repeated, frequently 
with a "help" message further clarifying the task, or of requesting the 
correct answer to any problem. Instructions are as short as possible, 
and the nature of the task is the same throughout a lesson. 

Our ability to measure degrees of correctness objectively is limited. 
Thus, the course is planned to avoid any ambiguity in the choice of cor- 
rect answers. In a lesson with tasks that might lead to ambiguity, the 
first few problems give extra help to the student, allowing him to see a 
pattern and then follow it on his own throughout the lesson. The course 
does not list rales of English usage; rather, it illustrates particular 
patterns of English and provides drill for the student to develop his 
own understanding. 
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Students taking the course may receive appropriate correction for 
their particular wrong responses. For almost every exercise throughout 
the course, careful attention has been given tc a variety of likely 
wrong answers. Short but helpful messages, explaining the nature of the 
error, are returned immediately after a particular wrong response. An 
attempt is made at all times to reinforce any response which contains a 
part of the correct answer and to lead the student to the complete cor- 
rect answer. 

CAI differs from ordinary classroom instruction particularly in the 
ability to store complete response data. This ability qualifies it as a 
research tool as well as a teaching medium. Precise information on each 
student's response is stored for later analysis and revision of the course. 
Daily reports are written and may be listed by teachers and the IMSSS 
staff to monitor students 1 progress and lesson scores. 

In all lessons except the review tests and the first introductory 
lesson, a student who demonstrates his ability to perform the task re-, 
quired early in the lesson is automatically branched to the next lesson. 
This is accomplished by a checkpoint after 6-9 items, requiring 85 percent 
correct responses on the_ first attempt to execute the branch. He is 
allowed to miss one problem, but not two or more, in order to branch 
ahead. In the "directions" lessons at the beginning of the course, 
scores are checked more frequently, allowing a student who has mastered 
the task by the middle of the lesson to bypass the rest. This branching 
scheme allows a student who is proficient on one topic to branch ahead 
to an area with which he may be less familiar. 

The Language Arts Course is intended to be a flexible set of lessons. 
Although the order of topics 5.s mixed, lesson names give an idea of the 
content of each. A teacher who chooses to vary the order of presenta- 
tion, or to give a particular student farther work in a particular topic, 
need only consult a brief outline, type a special command, and tell the 
program which lesson is desired. This allows for considerable flexibility 
to the teacher who wishes to use it. If teachers do not wish to take 
responsibility for this part of the language teaching, they may leave it 
to the CAI course and allow students tc follow the established sequence. 

Reports . The Language Arts Course collects complete data on each 
student's responses. This data is categorized and made available in 
reports summarizing various aspects of course usage. 

A daily report program makes available detailed information on stu- 
dent progress. The report gives information by IMSSS class number and is 
available both to teachers in the participating schools and to the IMSSS 
staff. An example of a daily report is shown in Figure U. The report 
heading documents the class number, teacher's name, date of the report, 
number of students in the class (including those not flagged for the 
grammar course), name of the school, and class grade. The first number 
in the row' of student information is the total number of lessons the 
student has completed to date. The number following that in parentheses 
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CLASS 5k2 MR. RAPHAEL 10 APR 72 

9 STUDENTS — VICTORIA SCHOOL - HOUSTON 

LANGUAGE ARTS (G) REPORT 



- GRADE 5 



57 ( 5) LESSONS lfOAl = 97$ 19.1 MIN + 283^ JERRY HOPKINS 
DAD 23/26 MAE 7/7 NPAC 7/8 DAE 

DAF 3/ 7 DAG (CONT) 



23 TOTAL LESSONS 
2 TOTAL LESSONS 



2837 MATT ARNOLD 
2950 BILL MORRIS 



Figure h. Illustration of Language Arts 
Curriculum "daily .ieport. 
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is the number of lessons completed on that day. After the word 'LESSONS 1 , 
the program prints the total score for the day (number of correct re- • 
sponses/number of completed problems) and converts the score to a 
percentage correct. The number of problems includes all problems com- 
pleted on that day, not just the problems in the completed lessons. 
Following the percentage score is the total number of minutes the student 
has accumulated in the curriculum, a plus sign if the student used the 
course on the date of the report, the student's number and his name. On 
the second and following lines, the report lists the names of lessons 
the student completed on the day of the report, giving a score for each 
lesson (number of correct responses/number of completed problems), If 
the student stopped in the middle of a- lesson, that lesson is listed but 
the score will not be reported. Exercises completed in unfinished les- 
sons will be added to the daily totals reported on the first line. If 
the student has not taken a lesson on the date of the report, only his 
number, name, and total lessons completed will appear. 

Another report is available that gives for each student all the 
lessons completed to date by name tod includes number of problems taken, 
percentage correct for each lesson, and an ordinal to indicate the order 
in which the lesson was taken. This report is not available "on-line" 
as is the daily report, but it is prepared and sent to teachers upon 
request. An example of this report; is given in Figure 5. The report 
is generated by scanning the stored student response data for a given 
class of students over a given period of time. The class number and 
period scanned are given in the heading. 

The IMSSS Language Arts Test 

During the spring of 1972 an extensive search was made for a paper 
and pencil language test that .would measure understanding of the lan- 
guage concepts covered in the Language Arts for the Deaf course c Few 
language tests were found which were at all suitable for deaf students: 
none were suitable for the GAL curriculum. She Full-Fang e Picture 
Vocabulary Test (Amnions and Ammons, 191*8) and the .Peabody Picture "Vocab- 
ulary Test (Dunn, 1959) are both fairly widely used* :<i^ school* for the 
deaf but they test receptive rather than expressive lang^ge' and they 
emphasize word, meaning rather than word usage* The Illinois Communication 
Scale (Withrow, 1966) also tests receptive rather than expressive language 
and the fact that it requires film makes it expensive and complicated to 
administer. The Language Test part of the Tests of Basic Experiences 
(Moss, 1970) also tests receptive rather than expressive language; only 
about 30 items test word usage as opposed to word meaning* Language 
Skills for Americans (Stillwagon and Leake, 1952), the Language Facility 
Test (Daily, 1968) 3 and the Language Usage Test developed at the Clarke 
School for the Deaf all test usage, punctuation^ capitalization, and 
spelling. Only a small number of items in these three tests cover the 
same topics that are covered by the CAI Language Arts course and many 
of the items are too difficult for the CAE students. The Gates-MacGintie 
Reading Tests (Gates and MacGintie, 1965), the Lee-Clark Reading Test 
(Lee and Clark, 1958), Primary Reading Profiles' " ( Stroud, Hieronymus, 
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class kf)l lj6-26-1971 thru 12-17- 1971 student k6f> Joyce Carey 

DA.H VAA 7 1&>$ VAB 7 M/IF 7 

VAC 7 VAD 7 85^ JAG 8 lpf$ TC 19 

VAE 28 57# AJAA 7 8558 AJAB 7 m>i AJAC 23 

MA.H 28 85?6 MM 27 77# NPAD 22 Jit NPAE 25 

NPAF 21 5755 AJAD 2j6 65$ MA.J 21 7656 MAK 



class hpl 1)6-26-1971 thru 12-17-1971 student k6l Gully Jlmpson 
INTRO 28 8556 DIR 21 6l# DIR2 . 7 100$ DIR3 



Figure 5. Example of the off-line Language Arts report for 
two students in class hOl.' The period scanned 
was October 26, 1971 to December 17, 1971. The 
entry for each lesson consists of lesson name, 
number of exercises completed in the lesson, 
and percentage correct. 



and McKee, 1957),; the Kansas Primary Reading Test (Schrammel, Hoag, 
Humble, Robinson and Wipf, 1935 )j and the News time Diagnostic Reading 
Test (1963) all test word recognition and reading comprehension rather 
than standard English usage* The language test developed at the Cali- 
fornia School for the Deaf at Berkeley (Marshall, 1952), the tests 
developed as part of the language curriculum, Generating English Sentences 
(Stokoe, Goldberg, Covington, LaRue, Womeldorf, and Bornstein, 1967), 
and the language tests developed at the Lexington School for the deaf 
(Cooper, 1965) all call for constiucted answers and provide no precise 
guidelines for correcting the test. The Picture Stoiy Language Test 
(Myklebust, 1965) covers many of the same aspects of usage that are 
covered in the Language Arts curriculum, but the complexity of scoring 
this test makes it impractical for a large number of students. The 
Illinois Test of Psycholinguistic Ability (McCarthy and Kirk, 1963) is 
^used in several schools for the deaf and many teachers consider it a 
valuable diagnostic tool* ' Because it can only be administered individ- 
ually, however, it would be impractical for testing all of the students 
working on the CAI curriculum* The Stanford Achievement Test (Kelley, 
Madden, Gardener, and Rudman, 1966) and the Metropolitan Achievement 
Test (Durost, Bixler, Wrightstone, Prescott, and Balou, 1970) are being 
administered in many of the schools where the Language Arts course is 
being used. Again, however, these tests do not test the precise topics 
covered in the CAI course. 

The decision was made to develop a set of tests for external evalu- 
ation of the Language Arts curriculum. It was beyond the scope of the 
project to develop a broadly applicable language test, although there is 
a need for such a test in schools for the deaf. Instead^ it was decided 
to write a criterion test to measure only the objectives of the grammar 
course. The test items were modeled on the items in the Language Arts 
course. The test was written for paper and pencil administration so it 
coiuld be given to students who had not taken any CAI. 

A preliminary version, containing 78 questions, was developed in 
May, 1971» This version was divided into eight subtests that covered 
the following topics: directions, parts of speech, noun phrases and 
double verbs, deteiminers, singular and plural noun forms, pronouns, 
subjects and predicates, and adjective transforms. 

The 1971-72 version of the test covered most of the topics taught 
in the first 200 lessons of the course. The test had 108 questions plus 
one or two sample questions for eacn subtest* The test was divided into 
15 subtests as follows: 



Subtest 
Subtest 
Subtest 
Subtest 
Subtest 
Subtest 
Subtest 



1 - Directions 

2 - Identification of nouns and pronouns 

3 - Identification of adjectives and determiners 

k - Identification of verbs (including double verbs) 

5 - Identification of noun phrases 

6 - Choose the correct determiner 

7 - Choose the correct noun 
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Subtest 8 - Choose the correct pronoun 

Subtest 9 - Choose the correct verb (tense and number) 

Subtest 10 - Write singular and plural nouns 

Subtest 11 - Negative transforms 

Subtest 12 - Adjective transforms 

Subtest 13 - Possessive noun phrases 

Subtest Ik - Inflections of "to be" 

Subtest 15 - Contractions 



The 1971-72 version was administered to approximately 500 students 
in participating schools in the fall of 1971. The administration in- 
cluded the 76 hearing fifth-graders and hf of the 20U hearing impaired 
students who were receiving math strands CAI but not the grammar cur- 
riculum. Responses on the test were stored on computer disk file as 
correct, incorrect or no response along with the" student*s name, DISSS 
* student number, IMSSS class number, sex, birthdate, date of test admin- 

istration and number of grammar lessons completed on the date of testing. 
The test was given to as many of these same students as possible in 
May, 1972. 

The goals of the course with lessons and subtests cross-referenced 
are listed in Appendix C. 

1971-72 Fonnative Evaluation of the Language Arts Curriculum 

The 1971-72 evaluation of the Language Arts curriculum for the deaf 
was intended to be exploratory and formative rather than summative. The 
emphasis of the assessment was on how well the curriculum meets its 
objectives rather than on how appropriate these objectives are to broader 
school goals. The 1971-72 assessment was intended to be as thorough as 
possible in meeting its aims. 

Curriculum lessons . Difficulty levels for the lessons weie studied 
as simple proportion correct in each lesson. Two proportions were gen- 
erated for each lesson: one for the first 7~9 exercises over all students 
and one for all exercises over just those students who were not branched 
out after the first 7-9 exercises. A matrix of correlations for lesson 
i with lesspn j (i < j) and a matrix of their associated standard errors 
of estimate was obtained in two ways : first, by using all students who 
completed the first 7-9 exercises in both lesson i and lesson j and, 
second, by using all students who completed all exercises in both lesson 
i and lesson j. A linear model was the only model used in considering 
the pair- wise relationships among the lessons, and there was no evidence 
to reject the model. The internal consistency of the lessons was esti- 
mated by the following form of the Kuder Richardson formula 20 suggested 
by Walker and Lev (1953): 

m - X V N(N-l)s* / 
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where m 



is the number of items in the lesson, 



is the number of students who have completed all items in 
the lesson , 

is the proportion of students who answered the ith item 
correctly, 

(l-p^ = proportion of students who answered the ith item 
incorrectly, 

is variance of the Jjesson scores of the N students if each 
score is number of items answered correctly by the individual. 

In this calculation we assume the matrix of inter-item correlations has 
a rank of one and that all the intercorrelations are equal. 

Curriculum items . Item difficulty was examined as simple proportion 
correct on first responses to each item; however, all the items were 
classified according to curriculum objective represented and exercise 
task in accordance with each of the task categorization schemes so the 
effect of the curriculum objectives represented or the exercise task on 
the difficulty of the item could be estimated by comparing across cate- 
gories and by using stepwise multivariate linear regression. Matrices 
of item point biserials and standard errors of estimate were generated 
for each lesson. 

Subtests . Difficulty levels for the subtests were studied as simple 
proportion correct in each subtest. Matrices of correlations and standard 
errors of estimate were generated to determine the inter- relationships 
among the subtests. Only a linear model was considered as a basis for * 
the inter- relationships, and there was no evidence to reject the linear 
model used. The internal consistency of the subtests was estimated by 
the Kuder Richardson formula 20 given above. 

Subtests and lessons . It is important to determine the relationship 
between subtests and the curriculum lessons. In pre- testing, the subtests 
that reflect given objectives of the Language Arts curriculum should pre- 
dict performance in lessons reflecting the same objectives. In post- testing, 
proficiency with respect to given objectives should be reflected both in 
the lessons and in the subtests. The assumed model of relationship between 
subtests and lessons was a linear model. Matrices of correlations and 
standard errors of estimate were generated for pre-test subtests and les- 
sons and for post- test subtests and lessons. Lesson scores used in gener- 
ating -these matrices were obtained in two ways: first, only the initial 
7-9 exercises in the lessons were used and all students who completed these 
exercises were included j second, all exercises in the lessons were used 
but only those students who completed all exercises in a given lesson and 
did not branch ahead after the initial 7-9 exercises were included. 



N 




2 

s 

X 
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Standard subtests . A linear model was again examined as a basis for 
relationships between curriculum lessons or the IMSSS Language Arts sub- 
tests and reading and language arts subtests from standard tests such as 
the Stanford Achievement Test (SAT). SAT scores were available for about 
300 of the Language Arts students. Also, the test of English as a Foreign 
Language (TOEFL) was administered to about 25 pre-linguistically deaf 
high school students. The TOEFL is of particular interest as a measure 
of English usage by students whose "native language" is American Sign 
Language • 

A linear model was examined as a basis for the relationship between 
IMSSS subtests or curriculum lessons and standard subtests. The cur- 
riculum lesson scores were obtained in the usual way, i.e., one set for 
all students who completed the initial 7~9 exercises in each lesson and 
a second set for all students who completed all exercises in each lesson. 
Matrices of correlations and standard errors of estimates were obtained.. 

Student characteristics . The following measures were obtained from 
about 300 CAT Language Arts curriculum students in the California School 
for the Deaf - Berkeley, the Oklahoma School for the Deaf - Sulphur, and 
the Texas School for the Deaf - Austin: 

(1) chronological age, 

(2) hearing loss in better ear, 

(3) age of hearing loss, 

{k) number of years in a residential school for the 
hearing impaired, 

(5) sex, 

(6) number of CAE Language Arts lessons completed, 

(7) pre-test score, 

(8) standard test scores. 

These measures were entered as independent variables into multivariate 
stepwise regressions that take lesson score, post-test score, post-teat 
subtest score, number correct among all items covering a given curriculum 
objective, and number correct under all items covering a given exercise 
task categoiy, respectively, as the dependent variable. The intent of 
this analysis was to determine the relative importance of the student 
characteristics measured in accounting for variance in these variables. 

Assessment of the IMSSS Language Arts test . The Language Arts test 
was studied as a test in itself. Reliability as internal consistency and 
precision was estimated by the Kuder Richardson foimula 20 mentioned above. 
Predictive, validity of the test was estimated by the relationship of the 
pre-test subtests to lesson performance. Some estimates of concurrent 
"validity were obtained from the comparison of IMSSS subtests with stan- 
dard subtests. Content validity was estimated by comparing the curriculum 
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objectives covered by the test with the full list of curriculum objectives* 
The curriculum objectives not covered by the 1972 test are listed in Ap- 
pendix D. 

Two forms of the IMSSS test were created in 1971-72* Two complete 
sets of items were obtained by writing for each item on the original test 
a second parallel item. The resulting pairs of items were then assigned 
at random to two forms of the test labeled Form A and Form B. 

These forms were examined to ,see if they were parallel. According 
to Lord and Novick (1968) two distinct measurements X ga and are 

parallel if for every subject, a, in the population, = rt^a and 

<t(E ) = a(E. ). where rt indicates measurements with the same true scores 
ga na 9 

but possibly different error variances. More intuitively, two measure- 
ments are parallel if their expectations are equivalent and their observed 
score variances are equal. The degree to which the two forms are parallel 
was estimated by selecting eighty students at random from among the entire 
population taking the Language Arts curriculum and administering both 
Form A and Form B to all the students selected. Half of the students were 
selected at random and received Form A first; the remaining half of the 
students received Form B first. 

Experimental Treatments 

At the beginning of the 1971-72 school year the Language Arts cur- 
riculum students were assigned independently and at random to groups 
within each of three experiments. 

Experiment I is comprised of two treatment groups. One group re- 
ceives programmed correction messages that are tailored for specific, 
anticipated wrong answers. About half of the exercises in the curriculum 
include one or more of these programmed correction messages. Members of 
the second group in Experiment I do not receive these messages,? they are 
told only that a given answer is "WRONG." In accordance with their Ex- 
periment II treatment group, both Experiment I groups receive the correct 
answer after the wrong answer response is given. 

Experiment II is comprised of two treatment groups. One group, is 
allowed three trials per exercise, the second group is allowed only one 
trial per exercise. The members of the first Experiment II group receive 
either a programmed correction message or the word "WRONG," depending 
on their Experiment I treatment group, after the first and second trial 
on an exercise. They are not given the correct answer explicitly until 
the third trial unless the correct answer is part of a programmed cor- 
rection message. The correct answer is rarely included in these correction 
messages. 

Experiment III again is comprised of two treatment groups. In one 
group, members are given an opportunity to type the correct answer after 
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it is explicitly given following a wrong answer. In the second group, 
the correct answer is given explicitly, but students are not requested 
to type the correct answer after it is given. 

There are two groups under each of the three experiments yielding 
eight possible treatments under the experiments for any random student. 
The analyses of curriculum lessons and items, test subtests and items, 
subtest and lesson relationships, 3MSSS curriculum and test relationships 
to standard tests, and student characteristics will be done separately 
for each of these eight treatment groups. Treatment groups will be 
collapsed and analyses for the groups will be combined when there is no 
demons tratable difference between them. Analyses for the hearing im- 
paired math strands students and the hearing Language Arts students will 
also be kept separate yielding ten separate sets of analyses in all. 

Interaction of CAI with Classroom Instruction 

In March 1972, questionnaires surveying use of Language Arts materials 
were mailed to 72 schools for the deaf and hard of hearing. Information 
concerning both commercial and non- commercial materials was requested. 
Instances in which the scope of the questionnaire appeared too limiting 
are being followed-up by personal interviews. 

There are three purposes of this survey. First, achievement dif- 
ferences between classes of students that cannot be accounted for by the 
CAI intervention may be explained by the approach being used in the class- 
room. Further, the CAI sessions may supplement some classroom treatments 
better than others. The survey is intended as a basis upon which these 
questions can be investigated in 1972-73* Second, the survey should in- 
dicate ways in which the Language Arts curriculum can be better coordin- 
ated with the activities of the classroom teacher. Specific aspects of 
the curriculum may be usefully related to specific materials* Third, 
the survey should provide a check of the content validity of the curri- 
culum. In selecting the objectives and writing the lessons for the 
curriculum, priorities for presenting aspects of Language Arts curriculum 
were made operational. How valid and realistic these priorities are will 
be indicated by the survey. 

Study of Economics and Technology of the Network 

Introduction 

The primary effort under this contract has been, and will continue 
to be, the development and evaluation of computer-based curriculums that 
improve the quality of education for deaf children. However, develop- 
ment and evaluation are insufficient in themselves to" have a practical 
payoff for substantial numbers of deaf children. For this reason, we 
have investigated the operational implementation of our CAI development 
efforts. A central aspect of this implementation is basic economics of 
CAI— its cost, performance, and degree of substitutability for other 
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inputs into education of the deaf. We discuss these economic questions 
briefly below and describe a number of specific implementation alterna- 
tives. These alternatives are suggestive rather than exhaustive , and 
will be elaborated in the coming months. 

Basic Economics of Providing CAI 

The cost per operational CAT terminal in a school for the deaf 
depends on many factors related to the basic organization of the system 
that provides the service. In the next section, we discuss a number of 
alternatives and reference more detailed cost estimates for them. In 
this section, analyses of basic economic trade-offs will simply take 
conservative cost values based on estimates for the immediate future; 
we emphasize, however, that many components of these costs are declining. 

Our basic cost assumption is that for $300 per month a teletype ter- 
minal can be maintained in a typical school. This cost includes amorti- 
zation of capital costs, use of the central computer system, communications, 
proctoring, and supplies. It does not include any expenditures associated 
with making classroom space available. We also assume that for 20 days 
per month an average of 25 student sessions per day are given at each tele- 
type. Thus, we assume 500 sessions per terminal^per month at a cost of 
$300, or $.60 per session. We have observed high variance in the number 
of sessions per terminal per day obtained by different schools, and with 
effective scheduling it is feasible to obtain many more sessions per ter- 
minal per day than the 25 we assume. Many schools for the deaf are 
obtaining utilization rates in the range of 35-1*0 sessions per terminal 
per day, suggesting the possibility of substantially lower costs per 
session than the $.60 that we use. Also, we have assumed a 6-hour school 
day; the residential schools for the deaf are using their terminals 8-10 
hours per day, farther increasing the number of sessions per terminal per 
day and farther decreasing the cost per session. 

The decision of whether to provide CAI and how much CAE to provide 
depends not only on cost per session but on two other critical factors. 
First, of course, is the performance of CAI in raising student achievement, 
and this aspect is discussed elsewhere in the proposal. Second is the 
issue of what must be given up in order to have CAE. Given that budgets 
are inevitably constrained, the more CAI an administrator provides his 
students, the less he can provide of something else. A requirement of 
good administration is to make these trade-offs explicitly, both in terms 
of their cost and 'of their performance. Due to the low student-to-staff 
ratios, a larger fraction of resources goes into staff in schools for the 
deaf than in other schools, and the most feasible way of financing CAI is, 
therefore, through slight increases in the student-to-staff ratio. This 
method is the most feasible even if new resources for acquiring CAI come 
from outside the school; the new funds could have been allocated to lower- 
ing the ratio of students to staff rather than to providing CAI. 

The trade-offs are summarized in the following equation adapted from 
Jamison (1971). 
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s* = s + 



(S*W*(1 - R)) + (C(N)*S 2 *R) 



W - (C(N)*S*R) 



(1) 



where S* is student-to-staff ratio after introduction of CAI, 

S is student-to-staff ratio before introduction of CAI, 

W is average annual salary of the instructional staff, 

R is ratio of the post-CAE instructional cost per student 
to the pre-CAE cost, and 

;C(N) is the cost of providing a student N sessions of CAE 
per year. 

To estimate the "opportunity" cost of CAT, we solve equation (l) 
for S* as a function of N (the number of CAI sessions per student per 
year) under the assumption that R - 1; i.e., we assume that CAE is 
introduced into schools for the deaf with no net increase or decrease 
in per-student instructional costs. To complete the calculation we need 
to know staff salaries and staff-to-student ratios, and Table 13 displays 
this information for a number of different types of schools for the deaf. 
For the present illustration, we consider public day schools where the 
instructional staff salaries averaged $8760 per year and the student-to- 
instructional-staff ratio was 4. 5. We have, then, 53 = 1*.5, W n 876O, 
R = 1, and, using the previous assumptions about costs, C(N) = $.60H. 
Equation (l) becomes: 

S* = k.5 + 12.l5N/(8760 - 2.7N) . (2) 

Table Ik shows the student-to-staff ratio calculated from equation (2) 
required to leave per-student instructional costs unaltered if each 
student has N CAI sessions per year for six values of N. 

It is evident from Table lh that substantial amounts of CAI are 
feasible with only minor increases in student-to-staff ratios. For 
example, increasing the student-to-staff ratio by 10 percent, from M.5 
to l+.95j would allow each child to have almost two CAE sessions daily 
(300 per year). The question facing the school administrator is whether 
the achievement gains resulting from this much CAI would counterbalance 
the Achievement losses (if any) resulting from the slightly lower staff- 
to-student ratio. 

Implementation Alternatives 

In the preceding section we outlined the basic economic considera- 
tions that would lie behind an administrative decision to utilize CAI in 
schools for the deaf. There remains the question of exactly how to im- 
plement the results of the development efforts supported by the Bureau 
of Educaticnfor the Handicapped at Stanford. We are analyzing four 
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UIBIE 13 

Salaries and Student-to-Staff Ratios in Schools for the Deaf 
for the 1968-69 School Year 



Average annual salary Ratio of students to 
Type of richool of instructional staff instructional staff 



Public Res. Schools 


*75& 


5.6 


Private Res. Schools 


6251 




Public Day Schools 


8760 




Private Day Schools 


6009 


M 


Public Day Classes 


7721 


3.9 


Private Day Classes 


77^0 


k.k 



Source: "Tabular Statement of American Schools and Classes for 
the Deaf, October 31, 1968," pp. 622-623 of the Directory of Services 
for the Deaf in the United States — American Annals of the Deaf, May, 
1^9. 
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TABLE lb 

Student -to-Staff Ratio Required to leave Per-Student Instructional 
Costs Constant with Implementation of 

Number of CAI sessions per year Student-to- Instructional-staff ratio 



0 


h'.50 


100 


k.6k 


200 




300 


^.95 


500 


5.30 


1000 


6.50 



The figures in this table assume a pre-GM trtudent-to- instructional- 
staff ratio of k*5 and an average annual salary for the instructional 
staff of $8760> CA1 is assumed to cost $#60 per 6 to 10 minute session* 



possibilities for the 1973-7^ school year and after, when the present 
phase of our development efforts will be concluded 

The firs*, implementation alternative would consist of operational 
utilization cf the IMSSS facility at Stanford, with the Stanford staff 
continuing in their liaison, maintenance, and administrative roles . By 
the beginning of the 1973-7^ school year, up to 300 terminals at various 
locations around the country could be made available enabling 5,000 to 
10,000 deaf students to receive CAI as a standard part of their curric- 
ulum. The total cost per terminal per month would be between $250 and 
$1*00* This approach would have the advantage of being a direct exten- 
sion of the services currently provided by Stanford and implementation 
problems would be minimized, Further, if curriculum development for the 
deaf continues at Stanford, new and revised curriculum materials would 
be immediately available to all students in the network* 

The second implementation alternative is identical to the first 
except that major administrative and operational responsibilities would 
be transferred to a school serving the deaf community, for example, 
Kendall Demonstration Elementary School* That school would be respon- 
sible for liaison with other schools, communications, teletype mainte- 
nance, and administration of everything except the central computation 
facility at Stanford* The major attraction of this approach lies in the 
gradual but explicit transfer of technological expertise and control from 
the developers of the CAI system to the users . 

A third alternative would be to implement the curriculums developed 
at Stanford with stand-alone mini- computer systems, The central proces- 
sor on such systems requires no operator, and it is capable of serving 
8 to 16 student terminals with relatively simple curriculum materials. 
Jamison, Suppes, and Butler (1970) provide a more detailed description 
and cost analysis for systems of this sort. Communication and multi- 
plexing costs would be minimized by the small geographical dispersion 
of users. Per- terminal costs using this approach would be approximately 
two-thirds to three-fourths the costs involved in the first and second 
alternatives. However, the range of curriculums offered on mini-systems 
is more limited than in the first and second alternatives, and curriculum 
revision is far more difficult. 

A fourth alternative, diametrically opposite to the third, would 
be to establish a large CAI center for the deaf that would be capable 
of simultaneously running 500 to 1,500 terminals* Such a center would 
require nationwide communications. It could take full advantage of new 
and revised curriculums as they become available, and it could provide 
a wider range of curriculums than could a mini-system. Ball and Jamison 
(1972) provide a detailed description and cost analysis for a system 
capable of widely distributing the curriculums now being developed for 
the, deaf. Ball and Jamison conclude that use of communication satellites 
appears to be an economically attractive way of distributing CAI to a 
population as dispersed as that of deaf students. Per- terminal costs 
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for a large-scale system such as this would probably fall between those 
of a mini-system and those of an expanded Stanford-based system. The 
difficulty with proceeding directly to this option is the substantial 
time lag between decision and implementation and the administrative dif- 
ficulties inherent in expanding a small scale of operations to a very 
large one. 

Grammatical and Semantic Analysis of Deaf Students 1 Talk on Teletypes 
The SAMPLE Corpus 

An important first step in examining the language of hearing- impaired 
students is the collection and analysis of a corpus of writing samples. 
We have begun an intensive analysis of a small sample of the written lan- 
guage of deaf students obtained from Kendall School for the Deaf in 
Washington, D.C. and the California School for the Deaf in Berkeley, Cali- 
fornia. This corpus, which we call SAMPLE ^ has been edited and divided 
into 1311 sentences. An informal way to describe these sentences is to 
say that they are analogous to the "complete thoughts 11 of classical 
grammar. Nearly all of the "complete thoughts" in the writing samples 
were terminated by conventional punctuation so the original corpus was 
modified very little in selecting the sentences. 

Sentence length analysis . To analyze the length of a sentence, we 
let a word be defined as an unbroken string of the following characters: 

a , b, c , . . » , z-, 0,1,2,. . . ,9 y "* • 

The dash (-) is used to indicate several words that should be thought of 
as single semantic units, such as 

junior- high, 
bay-bridge, 
jr-league, 
aunt-geraldine , 
mr-ben-provance . 

We ignored the distinction between capital and small letters because it 
is doubtful that the upper-lower-case distinction carries much semantic 
import. The length of a sentence was defined as the number of words it 
contains. This definition does not correspond to many standard defini- 
tions of morphology. However, it is appropriate for semantic analysis. 

In written English the characters of punctuation often indicate the 
phrasing of sentences. We have not considered this as a part of the de- 
scription of the SAMPLE corpus. Punctuation characters are ignored in 
the analysis. 

The mean length of sentences in the SAMPLE corpus is 8.92, with a 
mode of 6. The variance is 25.76, giving a standard deviation of 5*08. 
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TABLE 15 

Length Distribution of Sentences in SAMPLE 
Prediction of Distribution Using Negative-binomial Distribution 3 



Length X 


Freq. X 


The or. freq. X 


The or. prob. 


Chi square 


1 


10 


20.70 


.02 


5.53 


2 


15 


50.42 


.04 


24.88 


j 




70.07 


• 06 


2.44 






100.40 


.08 


5.51 


5 




113.36 


.09 


3.76 


6 




118. Ok 


.09 


7.11 


7 


129 


116. oh 


.09 


1.45 


o 

o 


JJ.D 


109 • 27 


.08 


.42 


n 
y 


XOd 


99^0 


.08 


,0C 




ou 


oo«xo 


.07 


.76 


11 


78' 


76.42 


.06 


.03 


12 


61 


65.04 


.05 


.25 


15 


rQ 

50 


54.49 


.04 


.23 


Ik 


^y 


45.04 


.03 


5.71 


J-5 


33 


3O.O0 


.03 


.39 


■ 16 


20 


29.76 


.02 


3.20 


17 


28 


23.85 


.02 


.72 


18 


17 


18.96 


.01 


.20 


19 


15 


1^.97 


.01 


.00 


20 


8 


11.7^ 


.01 


1.19 


21 


7 


9.15 


.01 


.51 


22 


5 


7.10 


.01 


.62 


23 


7 


5.48 


.00. 


.42 


2U 




4.21 


.00 




25 


5 


3.22 


.00 


.33 


26 


3 


2.45 


.00 




27 


0 


1.86 


.00 




28 


1 


1.41 


.00 


.52 


29 


3 


1.07 


.00 


30 


1 


.80 


.00 




31 


1 


.60 


.00 




32 


1 


.45 


.00 




33 


1 


.34 


.00 




3* 


0 


.25 


.00 




35 


1 


.19 


.00 





(continued) 
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Table 15, continued 



Length X 


Freq. X 


The or. freq. X 


Theor. prob. 


■56 


0 


.lk 


.00 


57 


0 


.10 


.00 . 


58 


1 


.08 


.00 


59 


0 


.06 


.00 


IK) 


0 


.01* 


.00 


in 


0 


.05 


.00 


k2 


1 


.02 


.00 



Residual Expected Frequency = .06 

Sum of Theoretical Probabilities (Before Residual) =1.00 
Chi Square Sum = 7^.50 
Degrees of Freedom = 23 



.Parameters are P = .31 and R = 3^52. Distribution is started 
at X = 2., and values are shifted. 
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The distribution has a skew of .58, measured by Pearson's skew statistic. 
The longest sentence length was k2. Table 15 gives the distribution of 
the sentence lengths in SAMPLE. 

There is an interesting theoretical problem connected with the 
length of the sentences in a corpus, and that is to account for the dis- 
tribution of lengths with a fomal model of utterance generation* A 
classical approach to the problem of finding underlying models is to 
look for functions that "fit" the empirical distribution, and then ask 
what behavioral models the functions suggest. Three plausible functions 
are the geometric , the poisson , and the negative binomial . Using the 
maximum likelihood method to estimate the parameters associated with 
these distributions, and then computing the chi squares as measures of 
the goodness of fit, we have listed the results in Table l6.. 



TABLE 16 

Prediction of Sentence Length in SAMPLE 
Results of Several Models 



Model 

Geometric 
distribution 

-Poisson 
distribution 

Negative 
binomial 
distribution 



Sum of 
theoretical 
probabilities 



>99 



Chi square Degrees of 

sum Residual freedom 



loOO 



loOO 



586.52 



2093.80 



7^o50 



8.90 



0.00 



0.06 



32 



Ik 



23 



Table 16 shows that of the three theoretical distributions the negative 
binomial provides the best fit of the empirical data. Interestingly, 
this result corroborates analyses we have completed on other corpora, 
including the speech of hearing children (ages 20-36 months) and hearing 
adults. Table 15 gives more detailed information on the negative binomial 
fit to the distribution of sentence lengths. 

Vocabulary and dictionary construction . There are 11,697 words in 
SAMPLE, but only 169b different words are used, i.e., 11,697 tokens and 
1,898 types. This tally indicates a fairly ^mall functional vocabulary 
for deaf students. Many of the words in SAMPLE occur out of proportion 
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to their occurrences in English, and we plan to compare word frequencies 
observed in SAMPLE and other corpora obtained from hearing- impaired stu- 
dents with Kucera and Francis 1 Computational Analysis of Present- Day- 
American English (1967)* Appendix E lists the 100 most frequently 
occuring words in SAMPLE in the order of their frequency of occurrence ♦ 

In order to automate the analysis of natural language so that suf- 
ficiently large corpora can be used., it is necessary to represent in the 
computer the syntactic and semantic properties of the vocabulary. In 
part, this is a programming problem that involves technical matters such 
as the representation, recall, and updating of information in a large 
data structure. It is also a theoretical problem requiring an examination 
of the language of the deaf student to determine what kinds of syntactic 
and semantic categories to create in the data structure. 

We have classified the" 1898 different words in SAMPLE into lexical 
categories indicating how these words were used by the deaf students in 
sentences. Since some words can be used in different ways in different 
sentences it is necessary to give multiple classifications to many words. 
Table 17 lists the categories used in this dictionary, documenting how 
many words are in each category, and giving the intuitive meaning of each. 
The syntactic categories are selected to correspond to the semantic ob- 
jects represented in the data base. Multiple categories for words that 
can function in several ways are indicated by commas in the categories. 
Contractions are indicated by the symbol ^^.whicn indicates that a 
single word combines two semantic roles. Such a word as "you 1 re" is 
categorized as a personal pronoun followed by a linking or auxiliary 
verb. This is in keeping with the traditional view cf contractions. 

The grammar of noun-phrases in SAMPLE . It is our experience that 
noun-phrases dominate much natural language, and this is true of SAMPLE. 
§y editing the text and selecting the parts of sentences that seem to be 
noun-phrases, we find that there are 2366 noun-phrases in SAMPLE. 

A methodological assumption that we have found useful in linguistics 
research is that it is important to construct a theory that accounts for 
the main features of language and indicates what are the remaining prob- 
lems. The construction of a grammar for noun-phrases is an example of 
this assumption. We look first at the noun-phrases because they are the 
predominant feature of SAMPLE. Moreover, the addition of the concept of 
a probabilistic grammar is also a useful part, of this approach since it 
gives a sense of the relative impo: r tance that various structures have in 
the corpus. 

In Appendix E, we review some formal notions, such as context-free 
grammar and probabilistic grammar , and apply these ideas to the noun- 
phrase fragment of SAMPLE. By constructing probabilistic grammars for 
the noun-phrase fragment of SAMPLE we are attempting to test some 
hypotheses about the kinds of structures present* We are assuming that 
we already know something about the kinds of structure we will find in 
noun-phrases* For example, we expect to see some adjective phrases, 
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TABLE 17 

Grammatical Categories Used for the Dictionary for SAMPLE 



Frequency 

585 
208 
160 
"55 
25 



23 
15 
15 

ik 
13 



12 

12 
11 

9 

9 
9 

8 



Grammatical category 

n 
v 

adj 

pn 

adv 

pad j , n#aux, relink 



prep 



pron 



persp 

pad j , pn#aux, pr#link 



qu,pron 

int 
conj 

prep,adv 

mod 
padj 

misc 

link,aux 



(continued) 



Explanation (examples) 

common nouns - (car, cow) 

common verbs - (drew, talk, watch) 

common adjectives - (delicious, wet) 

proper nouns - (albany-hs, desi-arnaz) 

adverbs - (afterwards, later) 

words that can be either a possessive 
adjective,' or a noun followed by an 
auxiliary verb, or a noun followed 
by a linking verb - (children's, 
(parent's) 

prepositions - (about, of) 

noun or verb - (answer, cost) 

pronoun (other than personal) - 
(anyone, something) 

personal pronouns - (i, they) 

words that can be either a possessive 
adjective, or a proper noun followed 
by an auxiliary verb, or a proper 
noun followed by a linking verb - 
(jack's, Jill's) 

either a quantifying word or a 
pronoun - (all, that) 

interjections - (good-by, please) 

conjunctions - (and, but) 

either a preposition or an adverb - 
(around, outside) 

modal verbs - (can, must) 

possessive form of a noun - (doctor's, 
parents ' ) 

words defying classification - 
(accbiet) 

linking or auxiliary verb - (am, 
were) 
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Table 17, continued 



Frequency 


Grammatical category 


Explanat ion ( example s ) 


7 


n,adj 


noun or adjective - (gold, south) 


7 


pronadj 


possessive form of personal pronouns - 
( his . mine ) 


6 


v,mod 


common or modal verb - (go, wants) 


k 


v,aux 


common or auxiliary verb - (do, have) 


k 


intadv 


interrogative adverb-- (how, where) 


3 


art 


articles - (a, an, the) 


3 


mod#neg 


modal verb followed by a negating 
D&rticle — l can't * eo\3"ldn*"M 


3 


qu 


quantifying word - (every, only) 


2 


aux#neg, linkpieg 


auxiliary verb followed by negating 
word, or a linking verb followed 
by a negating particle - (aren't, 
wasn't) 


2 


link 


linking verb - (became, become) 


2 


v#neg,mod#neg 


common verb followed by a negating 
word, or a modal veTb fVvLlowpd hv 
a negating word - (didn't, don't) 


2 


persp#aux, persp#link 


personal pronoun followed by an 
auxiliary or linking verb - (he's, 
we 're ) 


2 


pron^aux, pron^link 


Dronoun followed bv an auxil iarv or 
linking verb - (i'm, that's) 


2 


neg 


negating word - (no, not) 


2 




em. -LLxnci oive woru — x^*^ yes y 


2 


inter 


interrogative pronoun - (what, who) 


1 


n,adv 


noun or adverb - (back) 


1 


v,adj 


live 


1 


v#neg,aux#neg 


hadn't 


1 


persp,pronadj 


her 


1 


pr on#mod , pr on#aux 


i'll 


1 


pron#aux 


i*ve 


1 . 


prep, con j 


then 


1 


persp#mod 


we'll 
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some prepositional phrases, and so on. The grammar is written with this 
in mind. What we do not know is the tendency to use, say, several ad- 
jectives, or the tendency to use prepositional phrases. 

The grammar GS1 for the noun-phrase fragment of SAMPLE is designed 
to make some simple tests. The main structure that we have assumed for 
the noun-phrases is: an (optional) adjective phrase, followed by a noun 
or noun-substitute, followed by an (optional) prepositional phrase. The 
optional prepositional phrase then contains something like a noun-phrase 
as the object of a preposition. gSI is designed to test the differences 
between the noun-phrase that is the object of the preposition, and the 
more general noun-phrase. 

Table 18 gives the rules of the grammar GSI together with the param- 
eters estimated from the noun-phrase fragment of SAMPLE. 

The rules are labeled ^with ordered pairs of numbers, for easy 
reference. The 2- rules, the rules that have a , 2 I as the first number 
of the label, generate the general noun-phrases, since ^p 1 is the start 
•symbol of GSI. The 5-rules generate the noun-phrases that are objects 
of the prepositions. Notice that rule (2,1) has an associated probability 
of .63, while similar rule (5>l) has a probability of .82. This indicates 
that there is a greater tendency for a noun or pronoun to stand alone 
(without modifying adjectives) as the object of a preposition than in 
the main noun-phrase. Similarly, compare the 3-rules with the 7-rules. 
The 3* rules generate adjective phrases for use with the main noun (or 
pronoun) of the noun-phrase, while the 7-rules generate adjective-phrases 
for use in modifying the noun (or pronoun) that occurs as an object of 
the prepositional phrase. The probabilities indicate: given that we are 
using an adjective phrase, the tendency to use a pronominal adjective is 
about the same (.65 in each case); however, the tendency to use more than 
one adjective is .05 for rule (3*2) but .00 for the corresponding rule 
(7,2). 

There is no one grammar for the noun-phrase fragment of SAMPLE. We 
have given here a grammar that accounts for most of the noun-phrases. 
For example, there were 330 noun-phrase types, representing 2366 tokens. 
Out of these, 182 types were recognized by GSI, representing 2150 tokens. 
This means that 91 percent of the noun-phrases were recognized by the 
grammar GSI. Moreover, the grammar indicates some statistical differences 
in certain kinds of structures present in the noun-phrases » 

From the, view of the goodness of fit, the grammar is not veiy accept- 
able. The chi-square sum is 2502, with 11 degrees of freedom, and this 
is not a good fit, especially for a noun-phrase grammar. Table 19 lists 
all the noun-phrases, together with the observed and expected frequencies, 
and the chi-square contributions. 

Semantics of the context-free grammar . The importance of the context- 
free grammar is that the semantics can be a natural extension of the syntax. 
Each rule of the grammar is assigned a semantic function corresponding to 
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TA.BLE IS 

Grammar GS1 for Noun- phrases from SAMPLE 
Start Symbol Is NP 



Label 

[1,1) 
(1,2 
(2,1 
[2,2 

2 '? 
[2 f k) 

[2,5 

:3,i) 

[5,2 

(3,3 
(^i) 

M) 

5,1> 
(5,2) 
(6,1) 
(6,2) 

(7,1) 
(7,2) 

(7,3) 

(8,1) 

(8,2) 

(9,D 

(10,1) 

(10,2) 

(10,3) 
(io,M 

(10,5) 



Probability 


Rewrite rule" 


.1752 


npl -> adp nl 


.821+8 


npl -> nl 


.63^ 


np -> npl 


.1755 


np -» quart npl 


.0277 


np -> np prepp 


.111+9 


np .-> np npl 


.01+75 


np -> np con j np 


.21+81+ 


adp -> adj 


.01+59 


adp -> adp ad j 


.61+72 


adp -> pronadj 


.0585 


adp -> pad;} 


.1212 


quart -» gu 


.8788 


quart -> art 


.8205 


pnp -> pnpl 


.1795 


pnp -> pquart pnpl 


.2179 


pnpl -> padp nl 


.7821 


pnpl -> nl 


.3529 


padp -> adj 


.0000 


padp -> padp adj 


.61+71 


padp -> pronadj 


.211+5 


pquart -> gu 


.7857 


pquart -* art 


1.0000 


prepp -> prep pnp 


.601+2 


nl -» n 


.0182 


nl -> pron 


.3165 


nl -> persp 


.0007 


nl -> inter 


.0605 


nl -> pn 
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TABLE 19 

Seme High-frequency Noun-phrase Types in Relation to Grammar GSl 

Chi Square Contributions 



Observed 
frequency 


Expected 
frequency 


Chi square 
contribution 


Noun-phrase 

* 

type 


79^ 


355.996 


537.673 


persp 


29k 


165.281 


99.^7 


art n 


221 


93.^5 


172.66^ 


pronadj n 


213 


679.7^3 


319.801 


n 


92 


67.8^9 


8.2^5 


pn 


52 


38.921 


1^.065 


n n 


■39 


35.878 


.192 


adj n 




8.72^ 


70.365 


art adj n 


31 ' 


■9.^ 


^6.759 


art n n 


29 


22.797 


l.k26 


qu n 


17 


20.522 


.1*5 


pron 


17 


5.352 


23.22^ 


pronadj n n 


16 


8.1*2 


5.901 


padj n 


2150.000 


2150.0000 


2502.1335 


TOTALS 



(including some 
types not 
displayed) 

Degrees of Freedom = 11 

Chi Square/Degrees of Freedom « 227. 1*667 
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the way the rule introduces new concepts into the meaning of the sentence. 
For example , the first rule of our grammar for the noun-phrase fragment 
of SAMPIE allows an adjective phrase to modify a noun-phrase, as in these 
examples from SAMPLE: 

big boy 
' my black hat 

A standard function that we have found to be veiy successful with adjec- 
tive phrases is that of intersection. Thus, the meaning of the phrase 
f big boy 1 is the intersection of the set of big things with the inter- 
section of the set of boys. We jnay symbolize this by 

[big] n [boy] 

using standard set notation, plus the brackets to indicate the denotations 
of the words themselves. The meaning of 'my black hat 1 is then given by 

[my] n [black] "n [hat] . 

More complex functions are needed for articles, quantifiers, verbs, and 
adverbs • 

It should be emphasized that we are not in a position to understand 
all constructions that the deaf student uses. We need, as a beginning, 
to obtain a few of the major constructions. This is the purpose of col- 
lecting a corpus of deaf writing for further research. 

The TAIK Program 

The data collected in SAMPLE is inadequate for the following reasons. 

1) SAMPIE consists of teacher selections of students* writing. Most 
of the samples are classroom exercises rather than spontaneous expressions. 

2) The total size of 1311 sentences is too small for serious linguistic 
analysis. The corpora of hearing children that we have analyzed have in- 
cluded as many as 10,000 sentences, and some future corpora will contain 
more than 1+0,000 sentences. 

3) Relevant data in greater quantity can be collected by obtaining 
sentences typed at CAI terminals by students. 

Therefore, we are collecting and propose to analyze a corpus of deaf 
written language using the TAIK program currently in operation on our 
system. 

Using this program we can obtain a sufficiently large corpus of the 
spontaneous writing of deaf students. The TAIK program is designed to 
let two or more students type messages to each other on teletypes. The 
messages are spontaneous, and the program records these messages (anony- 
mously) for our use in linguistics research. Since November of 1971 we 
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have collected about 3000 sentences written by deaf students using the 
TALK program. 

With the additional samples obtained froai the continuing use of 
TALK by deaf students, the program will provide us with the most exten- 
sive corpus of the spontaneous writing of the deaf that has, to our 
knowledge, been collected. It will form the basis of research directed 
toward the construction of a computer interaction system. 

An Interactive, System for Elementary Mathematics 

The syntactic-semantic structures contained in common textbooks of 
elementary mathematics have been carefully examined as part of the Insti- 
tute *s work. The following is a sample of sentences from Sets and Numbers 
(Suppes, 1969)* 

A set is a collection of things. 

We may use pictures and braces to show sets. 

Pair the sets! 

Sets are equal when they have the same things in them. 
Which are equal sets? 

Sets are unequal when they do not have the same things in them. 
We call £ the not-equal sign. 
Choose = or 

A set may have more than one thing in it. 
A set may have only one thing in it. 
The set with no things in it is the empty set. 
Which sets have more than one thing In them? 

Tie variety of syntactic forms present in L'ets and Numbers is limited and 
regular. Given both the simplicity of the syntactic foims used in Sets 
and Numbers and our analysis of the written language of hearing- impaired 
students , it will be possible to construct an interactive CAE system for 
deaf students using elementary mathematics as the subject matter. 

The first examples of having an interactive system for element aiy 
mathematics would be aimed at augmenting the strands mathematics program, 
especially the problem-solving strand, now currently being used jby a 
large number of the deaf students currently registered in our CAT system. 
In the first stage we would introduce meaningful*, simple tutorial instruc- 
tion, without stereotype, by careful attention to the grammar and semantics 
of elementary mathematical statements. We believe that this can be done 
in an effective way. At the second stage we would plan to accept simple 
questions from the students about elementary mathematical concepts. We 
expect to make much progress on this second stage during the coming year. 
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APPENDIX As 

Third Grade Vocabulary List for the Language Arts Course 



able ADJ. 
about ADV. 
across PREP, 
act V. 
afraid ADJ. 
after PREP, 
afternoon N. 
again ADV. 
against PREP, 
all DET. 
almost ADV. 
alone ADJ. 
along PREP, 
also ADV. 
always ADV. 
am V. 
and COWJ. 
angry ADJ. 
another DEL', 
any DEC 
apple If. 
are V. 
arm N. 

around PREP, 
asleep ADJ. 
as ADV. 
ate V. 
at PREP, 
aunt N. 
away ADV. 
a DET. 



baby W. 
back ADV. 
bad A 
bag 

ball N. 
bank N. 
bang INT. 
basket N. 
pear H. 

beautiful ADJ. 
beat V. 



because CON J. 
bed if. 

before PREP, 
began V. 

behind PREP, 
below PREP, 
bell N. 
best ADJ. 
better ADJ. 
between PREP, 
be V. 

bicycle N. 
big ADJ. 
bigger ADJ. 
birthday If. 
bite V. 
bit V. 
black ADJ. 
blanket N. 
blew V. 
block N. 
blue ADJo 
boat N. 
both DET. 
bottom K. 
bought V. 
box N. 
boy K. 
brave ADJ. 
bread N. 
break V. 
breakfast N. 
bring V. 
bright ADJ. 
brown ADJ. 
brook N. 
brother K. 
broken V. 
brought V. 
built V. 
busy ADJ. 
business N. 
but CONJ. 
butter N. 
by PREP. 
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cage N. 
call V. 
came V. 
can V. 
candy N. 
cart N. 
car N. 
carry V. 
care V. 
castle N. 
cat N. 
catch V. 
caught V. 
cheese N. 
children N. 
chief N. 
circus N. 
city N. 
clean ADJ. 
clever ADJ. 
climb V. 
close V, 
clop I«T. 
clock N. 
clothes N. 
cloud N." 
cloth N. 
coat N. 
Cbld ADJ. 
come V.„ 
coming V. 
cool ADJ. 
com N. 
corner N. 
course ID. 
could V. 
country N. 
cow N. 
cried V. 
crowd N. 
cry V. 
cup N. 
cut V. 



danger K. 
dark ADJ. 
day N. j 
deer N. 
deep ADJ. 
did V. 

different ADJ. 
dig V. 

dinner fi. 
does V. 
dog N. 
door N. 
down ADV. 
do V. 
dress N. 
drink V. 
drive V. 
dry ADJ. 
duck N. 



easy ADJ. 
eat V. 
edge N. 
egg N. 
eight DEC. 
either COMJ. 
elephant N. 
else ID. 
empty ADJ. 
end If. " 
engine K. 
enough ADV. 
ever ADV. 
every DET. 
even ADV. 
evening If. 
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ERJC 



f 



r 



[ 
[ 



I 

I 

I 
f 
I 
I 

I 
[ 



i ace jn* 


jttq y»/1 Oyi i*J 


lall V* 


gate a • 


iamily Au 


gave v» 


I arm 


get ¥• 


xar Auv . 


give v • 


iarnier i\U 


frlo/^ AT\T 
glaU HUOm 


-P«-ko»4> ATM/ 

last ADV. 


glass II* 


taster ADV. 


goat K* 


fat ADJ* 


going V* 


latiier 


gone V* 


leather lu 


good ADJ. 


I 660 V • 


got V* 


x eet 1)1 • 


go Vt . 


I eel. v» 


grass iL 


•Poll V 

x e JLL v • 


gray ADJ* 


text v* 


grandmother N. 


ience iv* 


grandfather W. 


xev Dhi* 


green ADJ. 


xieia iv* 


grew V. 


I1JJL ¥♦ 


great ADJ. 


line AEJ* 


ground W. 


una v* 


grow V. 


finger K # 


IlTSt ALU • 




fire 








live DET# 




flag N. 




flew V. 




fly v. 




toot W. 




food N. 








for PREP. 




forest N. 




forth ID. 




four DEI. 




found V. 




free ADJ. 




fresh ADJ. 




friendly ADJ. 




friend N. 




from PREP. 




front N. 




fruit N. 




full ADJ. 




fun N. 




funny ADJ. 





had V. 

hair N, 

happy ADJ. 

hard ADJ. 

has V. 

hat N. 

have V. 

hear V. 

head W. 

heavy ADJ. 

heard V. 

held V. 

help V. 

hello INT. 

hen N. 

her DET. 

here ADV. 

he PRO. 

hide V. 

high ADJ. 

hill N. 

him PRO. 

himself PRO. 

his DET. 
.hit V. 

hole K. 

hold V. 

home W. ■ 

hope V. 

horse N. 

hospital N. 

hot ADJ. 

house W. 

how ADV. 

huge ADJ. 

hunt V. 

hungry ADJ. 

hurry V. 
, husband N. 



idea N. 
if CONJ. 
important ADJ. 
indian N. 
into PREP, 
in PREP, 
is V. 
its DET. 
it PRO. 

i PRO. k 



job W. 
jump V. 
jumped V. 
just ADV. 



keep V. 
kept V. 
king W. 
kind N. 
kitten W. 
kitchen N. 
knew V. 
know V. 



lake N. 
land H. 
last ADJ. 
late ADJ. 
laughed V. 
lay V. 
lazy ADJ. 
led V. 
left V. 
let V. 
letter K. 
life N. 
lift V. 
light W. 
line W. 
lion W. 
listen V. 
little ADJ 
log N. 
long ADJ. 
loose ADJ. 
lost ADJ. 
lose V. 
lot ID. 
loud ADJ. 
love V. 
low ADJ. 
lucky ADJ. 
lunch N. 



machine ft. 
made V, 
make V. 
man N.DFJT. 
march V. 
matter, Ii. 
may V.* 
meat N. 
mean V. 
meet V. 
men N. 
met V. 
me PRO. 
middle K. 
might V. 
milk W. 
minute N. 
mind V. 
mirror W. • 
miss V. 
money N* 
more DET. 
most PRC. 
mother Ii. 
mouse W. 
mouth N. 
mountain N. 
move V. 
mrs M. 
mr N. 
much ADJ. 
must V. 
my DET. 



near PREP, 
nearer PREP, 
neck lu 
need V. 
never ADV. 
new ADJ. 
next ADJ. 
nice ADJ. 
night N. 
noise N. 
north N. 
nose N. 
not ADV. 
nothing PRO. 
now ADV. 
no DET. 



oak N. 
off ADV. 
office ft. 
often ADV. 
of PREP, 
oh INT. 
old ADJ. 
once ADV. 
one DET. 
only ADJ. 
on PREP-, 
open V. 
or COWJ. 
other DEI 1 , 
our DET. 
out ADV. 
over PREP, 
owl N. 
own ADJ. 
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pail N. 
paint V. 
palace Ii. 
paper N. 
park N. 
part N. 
parade W. 
path fl. 
paw N. 
pay V. 
pen N. 
pencil N. 
penny N. 
people N. 
perhaps ADV. 
pet N. 
picnic N. 
pie N. 
pilot N. • 
pile W. 
pink ADJ. . 
play V.. 
place N. 
please INT. 
policeman N. 
polite ADJ. 
pole N. 
poor ADJ. 
pop V. 
porch N. 
pretty ADJ. 
prince N. 
princess N. 
prize N. 
promise N. 
proud ADJ. 
pull" V. 
pumpkin W. 
put V. 



queen N. 
quiet ADJ. 
quick ADJ. 
quite ADV. 
quickly ADV. 
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rabbit fl. 
race N. 
rain N. 
ran V. 
rang V. 
read V. 
really ADV. 
ready ADJ. 
real ADJ. 
red ADJ. 
remember V. 
rest N. 
ride V. 
right ADJ* 
ring N. 
river N. 
road N. 
rode V. 
roof N« 
room N. 
rope N. 
round ADJ. 
row N. 
run V. 
running V. 



sad ADJ. 
safe ADJ. 
.said V. 
salt N. ' 
same ADJ. 
sang V. 
sat V. 
Saturday N. 
save V. 
saw V. 
say V. 
scare V. 
school N. 
sea N. 
seat N. 
second ADJ. 
secret N. 
see V. 
seen V. 
sell V. 
sent V. 
send V. 
set V. 
seven DEF. 
several DET. 
shall V. 
she PRO. 
short ADJ. 
zhot V. 
shook V. 
shoulder N. 
shop V. 
should V. 
shut V. 
side N. 
sight N. 
silver N. 
silly ADJ. 
sing V. 
sister N. 
sit V. 
six DET. 
sky W. 
sleep V. 
slowly ADV. 
small ADJ. 
smile V. 
smoke N. 
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snow N. 
soft ADJ. 
some DET. 

something PRO. 

song W. 

soon ADV. 

sorry ADJ. 

soup W. 

sound U. 

so -ADV. 
spend V., 
splash V. 
spoke V. 
spring K. 
spread V. 
stay V. 
station N. 
stand V. 
step N. . 
still ADV. . 
stick N. 
stop V. 
stopped V. 
stood V. 
store N. 
story W. 
stories N. 
strong ADJ. 
strange ADJ.' 
street K. 
straight ADJ. 
such ADJ. 
suddenly ADV. 
sugar N. 
summer W. 
sun W. 
supper N.„ 
sure ADJ. 
sweet ADJ. 
swim V. 



table N.. 
tail N. 
take V. 
tall ADJ. 
talk V. 
teacher N. 
tell V. 
telephone N. 
ten DET. 
terrible ADJ. 
that PRO. 
than COKJ. 
the DET. 
then PRO. 
these DET. 
then ADV. 
there ADV. 
their DET. 
this DET. 
think V. 
thought V. 
three DET. 
through PREP, 
threw V. 
thunder K. 
time N. 
tiny ADJ. 
tired ADJ. 
today N. 
together ADV. 
told V. 
tomorrow N. 
tongue N. 
too ADV.- 
took V. 
top N. 
town N. 
toward PREP, 
to PREP, 
trade V. 
train N. 
trap N. 
tree N. 
trip N. 
tried V. 
truck N. 
trunk N. 
try V. 
turn V. 
twelve DET. 
two DET. 



uncle W. 
under PREP, 
until CONJ. 
up ADV. 
use V. 
us PRO. 



very ADV. 
village N. 
visit V. 
voice N. 



8 



wagon N. 
wait V. 
Walk V. 
wall N. 



yard II. 
yellow ADJ. 



yes INT. 
yet ADV. 
you PRO. 
your DET. 



wanted V. 
wane ADJ. 



was V. 
water II. 
way N. 
wear V. 



young ADJ. 



well ADV. 
went V. 



zoo N. 



were V. 
west N. 
wet ADJ. 
we PRO. 
what PRO.- 
when ADV. 
where ADV. 
wheel N. 
which ADJ. 
white ADJ. 
while CONJ. 
who PRO. 
whole ADJ. 
why ADV. 
wide ADJ. 
wife N. 
will V. 
wild ADJ. 
winter N. 
window N. 
win V. 
wind N. 
wing W. 
wish V. 
wise ADJ. 
with PREP, 
woke V. 
wolf N. 

wonderful ADJ. 
wonder V. 
work V. 
world W. 
word N. 
would V. 
write . V. 
wrong ADJ. 



APPENDIX B 

OUTLINE OF LANGUAGE ARTS FOR THE OEAF 
(1972 • 73 VERSION) 

Lesson Name Description 



1. 


INTPOD 


Int roduct 1 on 


to the eourse 








t l rsw aeconci, j a si letter 




n tp> 


w l "fwi l on i I 


a t t e r 






ui ~ect i ons § 


Tirst, secono, third- fourth* last word 


c 

3- 




Mi reci i oni 1 


e~ter, oeiore, woras 


6. 
°t 


n res 


LI rectlonsi 


first- second- third- fourth, Jeet# 
after the first, before the last, letter 


7. 


DXR6 


01 rectlonsi 


more than one word (spaces between) 


8. 


DXR7 


D1 rect 1 onsi 


more than one wordf first, second, third 
fourth, last, before the last wards 


o 
v l 


h T PA 


01 rect lonst 


below, under 


1 0 
1 U t 




01 rectlonsi 


above, below, under 


lit 


OTA 


Review test 






> 

M A A 


Common nouns, Introduction 




NAB 


Common nouns, continued 




ft A A 

PA A 


Determt ners 


Introduced (a, an, the) 




n A A 


vixea drlHt 


Identification of nouns and determiners 




MAD 

"Ad 


nixed drills 


nouns and determiners 


IT. 


MAC 


Mixed drllli 


nouns and determiners 


18, 


LAA 


Vowels Introduced 


i^. 


DAB 


Determiners! 


use of "a" and "en M 


20, 


MAO 


Identification of nouns end determiners 


21. 


RTB 


Review test 




22. 


NPAA 


Introduction 


of noun phrase (determiner noun) 


23. 


NPAB 


Noun phrase 


(single noun) 


24. 


DAC 


Cardinals as 


determiners 



25, 


N AC 


Plural 


nouns introduced 


26, 


NAD 


Plural 


nouns (*i) 


27. 


NAE 


PI u r a 1 


nouns »es5 


28, 


NAF 


PI urel 


nouns (»1ea) 




NAG 


Plural 


nouns, el 1 types 


30. 


NAH 


PI ural 


nouns, 1 rreeul ar 


31. 


RTC 


Review 


test 


32, 


DAD 


Det a rm 1 ner »noun agreement 1 


33, 


MAE 


Idant 1f1cat1on of nouns and 



3a 
35 
36 
37 
36 
39 
40 
41 
42 
43 
44 
45 
46 
47 
46 
50 
51 
52 
53 
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(some* every* no) 

nPAC Review noun, phrases (Including new determiners) 

DAE Deterr1ner»noun agreement (a, some) 

DAF Review determiners (a* tone) 

DAG Determiner noun agreement (a* an* some) 

VAA Verbs Introduced (one«word verbs) 

VAB One»word verbs, Indent i flcatlon 

MAF Mlxeo revlewi verbs, determiners, nouns 

VAC Review one and two word verbs 

MAG Mixed drill! Identify noun phrases and verbs 

RTD Rsvtew test 

VAD Models Introduced as part of two word verbs 

AJAA Adjectives Introduced (color, shape and size) 

AJAB Adjectives (Identify two 1n sentence) 

MAH Mixed drill t nouns, adjectives, determiners, verbs 

MAI Mixed dr111i nouns, adjectives, determiners, verbs 

NPAD Identify noun phrases with adjectives 

NPAE Noun phrases with adjectives 

NPAF First and second noun phrases 

AJAC Predicate adjectives Introduced 

2 



1 



3 



I 



» 

j 



] 
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5a, ma J Mixed review! noun phrases end verbs 

5S, RTE RevUw test 

56 f NPAG Nominative noun phrases ("who"* "what" questions) 

57 t NPAH Objective noun Phrases ("what" Questions) 

58 # NPAI Objective noun phrases ("what" Questions without 

adverblals 1n Question) 

59, NPAJ Nominative and objective noun Phrases ("who"* 

"what" Questions) 

60 t NPAK Nominative and objective noun phrases ("who"* 

"what" questions) 

61, NPAL Nominative and objective noun ohrases ("who"* 

"what" Questions) (without adverblals In -question) 

62, AJAD Adjective transform Introduced (subject noun ohrase) 

63, AJAfc Adjective transform (position of adjective) 

64, AJAF Adjective transform (object noun phrase) 

65, AJAG Adjective transform (position of adjective) 

66, RTF Review test 

67 • SAA Sentences! subject and predl cate 1 nt reduced 

68, SAB Subject and predicate* continued 

69, PNAA Pronouns Introduced (I* you* we* he* she* 1t* they) 
70 t PNAB Pronouns Introduced (me* him* her* It* us* them) 
7lt NP am Pronouns as noun Phrases 

72 t SAC Subject and predicate (pronoun subjects) 

73 t PNAC Pronoun-antecedent agreement (he* she* 1t) 

74 t PNAD Pronoun-antecedent agreement ("her father* " 

"his sister") 

75t NPAN Review singular and plural noun Phrases 

76 • PNAE Pronoun*antecedent agreement (1 1 * they) 

77, PMAP Pronoun-anteeedent agreement (he* she* 1t* they) 

78, RTG Review test 

79, MAK Mixed review! Identify nouns and pronouns 

3 



80, 



Mixed rtvltwi det«nH n«p$» adjeet<ves# nouns# verbs* 
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81, PNA6 Prcnoun*»enteeedent agreement Ht* them) 

82, PNAH Pronoun»entecedent agreement (her* him, 1 1# them) 

83, SAO Review subject end predicate 

84 , PNAI Pronoun»entecedent agreement (she* her, he# him) 

85 a PNAJ Pr onoun-entecedent agreement (them* they) 

86 t PNAK Pronoun»entecedent agreement (them# they) 
(some comoound subjecta and objects) 

87 a PNAL Review of all pronoun-antecedent agreement 

88, p TH Review test 

89, NPAO Singular and olura.1 noun Phrases, Including pronouns 

90, DAH Determiner Introduced (all) 

91, DAI Determ1ner«noun agreement (all, every) 

92, DA J Double determiners (with "all" and ce'cHnale) 

93, NPAP Singular and plural noun ohrasea 

94, NAJ Review Irregular olural nouns 

95* DAK Review determiner number (e# an, some* cardinals) 

96, NAJ ^lural nouns with same form as singular 

97, NAK Mixed review of plural nouns 

98, DAL Singula' and plural noun phrases (using "some" and 

"every") 

99, RTI Review teat 

100, SUAA Identify subjeetsf some sentences beginning with 

adverba 

101, SUAE Singular and olural subjects 

102, SUAC Singular and plural subjects 

103, 5UAD Compound subjects Introduced 

104, SUAE Singular and Plural subjects* some compound 

105, SUAF Number of subject) some sentences with edvetbe 

k 



r 



i 
i 
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106, VAE Subjeet-verb agreement (choose the verb)- 

107, VAF Suoject-verb agreement (choose the subject) 

lOfl, VAG Subjeet-verb agreement (so*e oronou* subjects) 

(choose the verb) 

109, HTJ Review test 

110, VAH Subjeet-verb agreement; some pronoun subjects 1 n- 

Including "I" and "vou" (choose the verb) 

lilt VAI Subject-verb agreement; some eronoun subjects 

(choose the subject) 

112, VAJ Subjeet-verb agreement; comoound subjects 

(choose the verb) 

113, VAK Subjeet-verh agreement; plural possessive Pronouns 

with singular subjects (choose the vero) 

lUi VAL Subject-verb agr-eement; several kinds of subjects 

(choose the verb) 

115, VAM Subject-verb agreement (choose subject or verb) 

116, SUAG Number of subject} some Irregular nouns 

117, SUAH Number of subject; some nouns with same singular and 

o1 ural 

116, RTK Review test 

119, VAN Subjeet-verb agreement; eo«e nouns with same singular 

and plural (choose the verb) 

120, vao Subject-verb agreement (choose subject or verb) 

121, VAP Y-les Inflections Introduced 

122, VAQ S-form of verbs ending In yl cry* stay* etc, 

123, VAR -es Inflection of verbs ending In -ch# -sh, »* 

124, VAS Spelling of -es and s-forms 

125, VAT Drill on s-forms; go-goes and do-does Introduced 

126, VAU S-form of HAVE Introduced 

127, VAV Mixed drill on s-ferm; change from plural to singular 

subjects 

128, RTl* Review test 

129, PRAA Introduce "oreposl ton" (1n# to* of) 
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130, PRAB 

131, PRAC 

132, PRAD 

133, PRAfc" 
13a, PRAP 

135, PRAG 

136, 6EAA 

137, BEAB 
136, BEAC 

139, RTM 

140, VAw 

141, VAX 

142, VAY 

143, VAZ 

144, VBA 

145, VBB 

146, PRAM 

147, PRAI 

148, PRAJ 



149, 
ISO, 
151, 



RTN 

PRAK 

PRAL 



152, PRAM 



Identify ©repositions (Introduce for* with* on) 

Introduce "prepositional phrase" (only PHEP DET N) 

Identify prepositional phrases (Introduce at* by* 
f rom) 

Identify oreoosl t 1 o«a1 phrases of several formal 
PREP ft, PREP DET N, PREP ADJ N, PREP DET ADJ N 

Identify prepositional phrases of several forms 
(Introduce after* Into* over* before) 

Identify first or second prepositional phrase 

Introouce "is-are" forms (with compound subjects) 

"1s*" "am*" "are" with various subjects 

Review "1s*" "a**" "are" with constructed answers 

Review test 

Subject-verb (-a) agreement) some Is-em-ene (choose 
t*e verb) 

Subject-verb (-es) agreement, some 1s-am-are (choose 
t*e verb) 

Subjeet-verb agreement, some 1s-am-ere (choose 
the noun or pronoun) 

Spelling of s-formst drill en "1s" end "are" 
Review of s-for«st HAVE* GO, DO 

Review of s-formsl HAVE* GO* DO, constructed answers 

Identify prepositional phrases of place 

Preposltlonel phrases of Piece (fill 1n missing 
preposition) 

Prepositional phrases of place (choose correct 
preposition) 

Review test 

Identify prepositional phrases of time 

Preposltlonel phrases of time (fill In missing 
preposition) 

Preposltlonel phrases of time (ehoose correct 
preposition) 
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178, 
179, 

180, 

181, 

162, 
183, 
164, 

ies, 

186, 
187, 

188, 
169, 
190, 
191, 
192, 
193, 
194, 

195, 
196, 
197, 
196, 

199, 
200, 
201, 



RTQ 
PRAN 

PRAO 

PRAP 

PRAQ 

PRAR 

"RAS 

VBS 

VBT 

VBU 

VBV 

RTR 

BEAD 

BEAE 

BfcAF 

BEA6 

BEAH 

NPAV 
NPAW' 
NPAX 
NPAY 

RT5 
SAC 
SAH 



Review test 

PreooslMonel phrases of Place and time (choose 
correct preposition) 

Prepositional phrases of Place and time (Insert 
correct preposition) 

Prepositional phrases of Place and time (Insert 
correct preposition) 

Prepositional phrases ("when" questions) 

Prepositional phrases ("where" auestlons) 

prepositional phrases ("when" end "where" questions 

Review pest tense end present progeaslvef »ed* *1ng 

Pest tense end present progressive! -d* drop f e ( ♦ Inp 

Pest tense end present progressive) y»1ed* double 
consonant verbs 

Pest tense end present progressive; various verbs 
Review test 

Connections of BE Introduces Identify contraction 

Contractions of BE) pronouns (constructed answers) 

BE contractions? noun phrases (constructed answers). 

Change BE contractions) pronouns (constructed answers) 

Change BE contractions) noun Phrases (constructed 
answers) 

Possessive pronouns Introduced 

Possessive noun phrese* pronouns) constructed answers 

Possessive noun phrase* pronouns) constructed answers 

Possessive noun phrase* nouns and pronouns) constructed 
enswers 

Review test 

Negative transform) forms of HAVE end BE 

Negative trensfor*) Insert ••not" 1n sentence) HAVE 
and BE 
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3 
1 



:l 



J 



1 



1 
] 
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202, SAI Review negative transform? HAVE* BE> end models 

203, mam Negative contractions Introduced? HAVE* BE, and DO 

204, man Negative contractions? BE (constructed answers) 

205, MAO Negative contractions? wave* BE, 00 (constructed 

answers) 

206 t map Change negative contractions? BE (constructed answers) 

207, mao Change negative contractions? HAVE* BE* DO 

(constructed answers) 

208; RTT Review test 

209, NPAZ Noun phrases ("who*" "whet" questions) 

210, PPAT Prepositional phrases ("when, " "where" questions) 

211, MAR Mixed review ("who," "what*" "when," and "where" 

Questions) (three Questions for one statement) 

2l2t MAS Mixed review ("wno#" "what#" "when," and "where 11 

Questions) (three Questions for one statement) 

213, SAJ Identify modal, have^word or be»word 

214, SAK Introduce Question transform? tvpe model* have-word 

or te»word (CA gives transform) 

215, SAL Question transform? "tyoe the modal or the heve*word 

or the be»word" (CA gives transform) 

216, SAM Question transform? identify correct sentence 

217, RTU Review test 
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APPENDIX C 

Specific Objectives of the Language Arte Curriculum 
with Lessons and Subtests Cross-referenced 



The objectives of the G-courae, Language Arts for the Deaf, 
are listed* The lessons of the G-course covering that objective, 
and the subtests of the 1971 ZM8SS Language Test covering tnat 
objective are given for each objective* 



Objective D(a) 

TYPE ANY LETTER OR LETTERS IN A GIVEN WORD IDENTIFIED BY ONE 
Or THE FOLLOWING: ORDINALS ( FIRST THROUGH FOURTH ), AFTER 
THE FIRST," FIRST TWO, LAST, BEFORE THE LAST, LAST TWO. 

Lessons 

DIR4,DIR5, DIR6, DIR8, DIR9, DIR11 , DIR12, DIR13, DIR14, DIR15, 
DIR16, DIR17, DIR18 

This objective was not tested because the same ordinals are 
covered in the next objective, and in the test these ordinals 
are not used to specify letters, but only to specify words* 



Objective D(b) 

TYPE ANY WORD OR WORDS IN A GIVEN SENTENCE IDENTIFIED BY 
ONE OF THE FOLLOWING! ORDINALS ( FIRST THROUGH FOURTH" ) , 
"AFTER" OR "BEFORE" A GIVEN WORD, BEFORE THE LAST." 

Lessons 

DIR1, DIR2, DIR3, DIR6, DIR7, DIR10, DIR20 
SUBTEST 1 



Objective D(c) 

COPY ON THE TELETYPE A TWO OR THREE-WORD PHRASE FROM 
A GIVEN SENTENCE, INCLUDING THE SPACE BETWEEN WORDS. 

Lessons 

DIR19 

This objective is not tested because it is only Important in 
order to correctly Input answers into the computer. 



l 



Objective D(d) 

SJfJSS-SJi^SS.*?!! SLSSSPHSJMS 22* comtainiiiq up to 

fZVS NUMBERS) 9 WW AMY MOMBBR WlOtt POSITION it SPECIFIED BY 
ABOVE* BELOW, OR UNDER ANOTHER NUMBER* 

Leteone r 

DIR21, DIR22* DIR23* DIR24* DXR25 

Thit objective was net totted because it it only important in 
ordtr to correctly respond when eekod to typo the nisAber under 
• specific word* This response Method it need in the G-course 
but not in the test. 



Objective 1(e) 

IDENTIFY ONE OR MORE ROOMS , IN EITHER A NOMINATIVE OR OBJECTIVE 
POSITION* 

ketone 

NAB* MA A, NAB* MAC* NAD* NAB* NPAC* NAP* NAB* MAI, MAL, 

NAN 

SUBTEST 2 



Objective 1(b) 

PBNTJFY ONE OR MORE Of, THE fOLLOWIMO AS DETERMINERS "A," "AN," 
W TMB 4 BOMB* m EVERY* NO** ALL, CARDINAL NUMBERS FROM 
ONE TO TEN* AND DOUBLE DETERMINERS WITH ALL OR CARDINALS* 

OAA, MAA* MAB* MAC* MAD* NAB* DAC* MAP* MAR* MAI* MAM* DAI* DAK 
SUBTEST 3 



ERIC 
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Objective 1(e) 

ZDBNTIPY ISOLATED VOWELS, AND SELECT FROM A GROUP OF WORDS 
TBS ORB TEAT STARTS WITH A VOWEL* 

Leaeon 

LAA 

This objective wae net teeted beeauae it la not * final 
objective bat only preparation for tho correct un of a" and 
an , which is teeted in eubteat 6* 



Objnctlva 1(d) 

XDBNTXPY ROOM PBRASBS (AFPEA RING ZN EITHER A NOMINATIVE OR 
OBJECTIVE POSITION) OP THE FOLLOWING TYPES t SIMOLB NOON OR 
PRONOUN, DETERMINER-NOUN , DETERNINER"A0JECTIVE*NO0N t 
DBTBRMINBR«DETSRMINBR«MOUN , ADJECTIVE-NOUN, DETERMINER- 
ADJECTI VB-ADJBCTI VE-NOUN • NOUN PHRASES NAY BB ORDINALLY 
SPECIFIED, SPECIFIED AS SINGULAR OR PLURAL, OR SPECIFIED AS 
POSSESSIVE* 

laaaona • 

NPAA, NPAB, NPAC, NAG, NPAD, NPAE, NPAP, KAJ, MAR, NPAG, NPAH, 
NPAI, NPAJ, NPAK, NPAL, NPAN, DAN, NPAN 

SUBTEST S 



Objective 1(a) 

SELECT FROM A GIVEN SENTENCE ONE CR MORE NOUNS SPECIFIED AS 
SINGULAR OR PLURAL 

laaaon 

MAC 

This objaetlva wae not tat tad baeauaa it la not a final 
objaetlva but only preparation for writing plural foraa of 
nouns, which la tasted in eubteet 10* 
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Objective 1(f) 

IDENTIFY AS VERBS, VERBS IN THE SIMPLE PRESENT. PRESENT 
PROGRESSIVE, SIMPLE PAST, PAST PROGRESSIVE OR MODAL FORM. 

lessons 

VAA, VAB, MAP, VAC, VAD, MAG, VAE, MAH, MAI , MA J, MAK, MAM 
SUBTEST 4 



Objective 1(g) 

"iw y^ ? "might^" A "must"^ N ' " " C0ULD »" " WILL »" "^uld." "should, 

lesson 

SAB 

This objective was not tested because It is not a final 
objective but only preparation for making a correct negative 
transform, which Is tested In subtest It. 9 



Objective 1(h) ' 

p^S?cI?b P aSe5t?ve1!! SBNTEMCE 0NE ° R M0RB N0MNAWVE 0R 
lessons 

AJAA, AJAB, AJAC, MAH, MAI, AJAD, MAK, MAM 
SUBTEST 2 



Objective 1(1) 

2f N "f*I?? COMPLETE SUBJECT (EITHER SIMPLE OR COMPOUND) AND 
THE COMPLETE PREDICATE OP A GIVEN SENTENCE AND INDICATE 
WETHER THE SUBJECT IS SINGULAR OR PLURAL. 

lessons 

SAA, SAB, SUAA, SUAB, SUAC, SUAD, SUAE, SUAF, SUAG, SUAH, SAC, 

This objective was not tested because It Is very similar to 
the Identification of noun phrases specified as singular or 
plural, which Is tested In subtest 5. ■xnguxar or 



Objective 



IDENTIFY AS PRONOUNS: HE,; SHE," "iT, "THEY, I, YOU," 
WE, ME,. HJM A HER. US AND THEM } AND AS POSSESSIVE 
PRONOUNS: MY, HIS, HER, ITS, "YOUR, OUR - AND xHEIR." 

lesson » 

PNAA, PNAB, PNAC, MAL, MAM, NPAR 
SUBTEST 2 



Objective 1(k) 

GIVEN A DECLARATIVE SENTENCE AND A RELATED QUESTION, IDENTIFY 
THE NOMINATIVE OR OBJECTIVE NOUN PHRASE THAT ANSWERS THE 
QUESTION. 

lessons 

NPAG, NPAH, NPAI 

This objective was not tested because it was included in the 
course cot as a final objective, but to give practice 
Identifying specific noun phrases, which is tested in subtest 5. 



Objective 2(a) 

SUPPLY THE PLURALS OF GIVEN SINGULAR NOUNS, AND THE SINGULARS 
OF GIVEN PLURAL NOUNS, BOTH REGULAR AND IRREGULAR. (REGULAR 
NOUNS INCLUDE THOSE WHOSE PLURALS ARE FORMED BY ADDING -S. 
( y )**5 ES 0R i^l-VES. IRREGULAR NOUNS GIVEN ARE: "MAN, 
WOMAN, CHILD. FOOT, MOUSE, SHEEP, DEER, ASPIRIN* 
AND OFFSPRING. 

lessons 

NAD, NAE, NAF, NAG, NAH, NAI, NAJ, NAK 



SUBTEST 10 



Objective 2(b) 

INDICATE WHETHER A SPECIFIED NOUN PHRASE IS SINGULAR OR PLURAL. 

lessons 

NPAK, NPAL, NPAM 

This objective Is not tested because it is not a final 
objective, but only preparation for Identifying noun phrases 
specified as singular or plural, which is tested in subtest 5. 



Objective 2(c) 

GIVEN THE ROOT PORN OP A VERB, SUPPLY THE GENDER MARKED FORM 
(THIRD PERSON SINGULAR), SIMPLE PAST, OR PRESENT PARTI CPLE. 
VERBS GIVEN ARE REGULAR, (INCLUDING THOSE ENDING WITH SINGLE 
CONSONANTS AND — Y) AND THE IRREGULAR VERBS "HAVE, "GO AND 
DO IN THE THIRD PERSON SINGULAR AND PAST FORMS. 

lessons 

VAL, VAM, VAN, VAO, VAP, VAQ, VAQM, VAR, VAS, VAVT, VAY, VAZ, 
VBA, VBB, VBC, VBCM, VBD, VBE, VBF, VBG, VBH, VBI, VBJ 

This objective was not tested because of the difficulty of 
correcting constructed answers, and because the final 
abjective, choosing the correct verb form to complete a 
sentence, is tested in subtest 9. 



Objective 3(a) 

TYPE "a" OR "AN* BEFORE A GIVEN NOUN IN A SENTENCE, DEPENDING 
CN THE PIRST LETTER OF THE NOUN. 

lessons 

DAB, DAG, DAH, DAL 
SUBTEST. 6 
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Objective 3(b) 



CHOOSE, FROM TWO GIVEN DETERMINERS, THE ONE THAT AGREES IN 
NUMBER WITH A GIVEN SINGULAR OR PLURAL NOUN IN A SENTENCE. 

lessons 

DAC, DAD, DAE, DAP, DAH, DAI, DAJ, DAL, DAM 
SUBTEST 6 



Objective 3(c) 

CHOOSE, PROM TWO GIVEN PRONOUNS, THE ONE THAT IS APPROPRIATE 
EITHER IN NUMBER OR GENDER OR CASE OR ALL THREE TO THE NOUN 
PHRASE THAT IT WILL REPLACE. 

lessons 

PNAD, PNAE, PNAP, PNAG, PNAH, PNAI , PNAJ, PNAK, PNAL 
SUBTEST 8 



Objective 3(d) 

CHOOSE THE CORRECT INFLECTION OF A VERB BASED ON SUBJECT VERB 
AGREEMENT IN NUMBER 

lessons 

VAF, VAG, VAH, VAHM, VAI, VAJ, VAK, VAT, VAU, VAV, VAVM, VAW, 
VBP, VBQ, VBR, VBS 

SUBTEST 9 



Objective 3(e) 

CHOOSE THE CORRECT INFLECTION OF THE PRESENT TENSE OF "BE* TO 
COMPLETE A SENTENCE. 

lessons 

BEAA, BEAB, BEAC, BEAD, BEAE, BBAF, BE AG, BEAH, BEAI, VAT, VAV, 
VBK, VBL, VBM, VBN, VBO, VBP, VBQ, VBR, VBS 

SUBTEST 14 
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Objective 3(f) 

GIVEN THE ROOT FORM OP A VERB, CONSTRUCT THE CORRECT FORM OF 
THE PRESENT PROGRESSIVE TO COMPLETE A SENTENCE. 

lessons 

VBG, VBH, VBI, VBJ, VBL, VBM, VBN, VBO 

This objective was not tested because of the difficulty of 
correcting constructed answers. Identification of the present 
progressive as a verb is tested in subtest 4, and choosing the 
correct inflection of the present tense of "be" to complete a 
sentence with the present progressive is tested in subtest 14. 



Objective 4(a) 

COMBINE TWO RELATED SENTENCES INTO ONE BY SPECIFYING THE 
POSITION OF AN ADJECTIVE TO BE INSERTED. 

lessons 

AJAE, AJAF, AJAG, AJAH 
SUBTEST 12 



Objective 4(b) 

INDICATE THE NEGATIVE TRANSFORM OF A GIJJEN SENTENCE (INCLUDING 
A MODAL, A FORM OF HAVE OR A FORM OF BE") BY SPECIFYING 
THE POSITION OF NOT. 

lessons 

SAF, SAG, SAH, SAI, SAJ, SAK 
SUBTEST 11 



Objective 4(c) 

CONSTRUCT A POSSSESSIVE NOUN PHRASE FROM A SENTENCE OF THE 
FORM: NOUN PHRASE, FORM OF HAVE," NOUN PHRASE. 

lessons 

NPAO, NPAP, NPAQ, NPAS, NPAT 
SUBTEST 13 
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Objective 4(d) 

EXPAND A CONTRACTION OP "be" PROM A GIVEN SENTENCE. 

lessons 
BEAL, BEAM 

SUBTEST 15 
Objective 4(e) 

MAKE A CONTRACTION WITH "be" AND A PRONOUN OR NOUN PHRASE. 

lessons 

BEAJ, BEAK 

SUBTEST 15 
Objective 4(f) 

EXPAND A NEGATIVE CONTRACTION OF "BE." "HAVE" OR "do" FROM A 
GIVEN SENTENCE. 

lessons 

MAN, MAO, MAP 

SUBTEST 15 
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APPENDIX D 

Curriculum Objectives not Covered by the Language Arts Test 



The following specific objectives of the course, Language Arcs 
for the Deaf, are not covered by the test* Many of these are 
interim objectives and only the final objective was tested. 

D(a) Type any letter or letter » m in a given word w identi{ied 
by one of the following! ordinals ( f £rg t through fourth ) , 
%fter the„firsc," first two, last, before the last, 
"last two." 

D(c) Copy on the teletype a two- or three-word phrase from 
a given sentence, Including the space between words. 

D(d) Given two or three rows of numbers (each row containing 
up to three nymbers)^ type any number wno.se position is 
specified by above, below, or under another number. 

1(c) Identify isolated vowels, and select from a group of 
words the one that starts with a vowel. 

1(e) Select from a given sentence one or more nouns speci- 
fied as singular or plural 

1 (g) M Identi|y w as modflfi "can," "could," "will," "would," 
"should," "may, "might, must. 

1(1) Identify the complete subject (either simple or com- 
pound) and the complete predicate of a given sentence, and 
indicate whether the subject is singular or plural. 

1 (k) Given a declarative sentence and a related question, 
Identify the nominative or objective noun phrase that answers 
thco question. 

2(b) Indicate whether a specified noun phrase is singular 
or plural. 

2(c) Given the root form of the verb, supply the gender 
marked form (third person singular), simple past, or present 
participle. Verbs given are regular (including those ending m 
with single consonants and -y) and the irregular verbs have, 
"go," and "do" in the third person singular and past forms. 

3(f) Given the root form of a verb, conetruct the correct 
form of the present progressive to complete a sentence. 



APPENDIX E 



100 Most Frequently Occurring Words in SAMPLE 



57*i 


i 


33 


like 


523 


the 


33 


morning 


^31 


and 


33 


up 


1*22 


to 


32 


pod 


367 


my 


32 


new 


2k9 


a 


30 


good 


162 


in 


30 


want 


158 


was 


29 


him 


Ikk 


we 


28 


all 


Ikl 


is 


27 


am 


135 


he 


27 


family 


135 


went 


27 


from 


112 


at 


27 


girls 


110 


last 


27 


has 


107 


of 


26 


sunday 


103 


it 


26 


were 


97 


on 


25 


afternoon 


95 


for 


25 


bought 


75 


me 


25 


boys 


73 

1 


that 


25 


room 


71 


home 


25 


them 


67 


said 


25 


yesterday 


66 


£ome 


2k 


saw 


61 


will 


2k 


so 


61 


with 


2k 


there 


59 


his 


23 


happy 


58 


house 


23 


king- mid as 


57 


our 


23 


play 


55 


mother 


23 


when 


52 

✓ 


Saturday 


22 


back 


I18 


but 


22 


came 


I1.8 


gold 


22 


told 


I1.7 

• 1 


about 


21 


day 


k6 


you 


21 


school 




then 


21 


watched 


\2 


they 


20 


after 


ill 


father 


20 


ate 


ill 


her 


20 


bedroom 


!|0 


because 


20 


daughter 


i|0 


go 


20 


many 


39 


are 


20 


see 


39 


brother 


19 


by 


39 


friday 


19 


friends 


39 


she 


19 


got 


39 


two 


19 


man 


39 


very 


19 


other 


38 


have 


19 


put 


38 


night 


19 


touch 


35 


had 


19 


00 


35 


one 


18 


bus 



ERIC 



APPENDIX F 



Brief Description of Context-free Grammars 
and Probabilistic Grammars 



The following is a brief discussion of the notions of context-free 
grammar and probabilistic grammar . These notions are more fully described 
by Suppes (1970) from both fomial and methodological points of view. 

Let V be a set of symbols. Then, V* is the set of all finite 
sequences of elements of V , including the empty string, which is denoted 
by £ . Such finite sequences are sometimes called strings . V+ denotes 
V* - {£} . Small letters a,b,c, are variables ranging over members of 
V* . 

A structure, 
G = (V,VT,S,P) 

is a generative grammar just in case G satisfies the following conditions 

1) V is a finite nonempty set of symbols, the vocabulary ; 

2) VT is a nonempty subset of V , known as the terminal vocabulary 
(the nonterminal vocabulary VN = V-VT) ; 

3) S is a distinguished element of VN , called the start symbol ; 

k) P, the set of productions or rules , is a finite subset of the 
set V+TV*".. 

Let VT+ be the set of all finite nonempty terminal strings. 
Further, if (a,b) € P , then we write (informally) 

a b 

to indicate that this is a production in P . a is the left-hand side 
(lhs) of (a,b) and b is the right- hand- side (rhs) of (a,b) . 

If a,b are strings in V* , then b i£ immediately produced from 
a if and only if there is a subsequence a 1 in a and a subsequence 
b 1 in b such that b is the result of substituting b 1 in a for 
a 1 , and such that 

a' -> b 1 

is a male in P . The intuition here is that an immediate production is 
what one obtains by replacing into some string for the left-hand side of 
some production by the right-hand-side of that production. 



If a,b are in V* , then b is derivable from a if and only if 
there exist 

al, a2, . an for some n 

such that 

a (immediately) produces al 
al produces a2 
a2 produces a3 

an produces b . 

The sequence (a,al) (al,a2<), . . . , (an,b) is called a derivation of b 
from a . 

As an example of these ideas, consider the following grammar G 
that generates a few English sentences. 

G = (V,VT,S,P) 

where 

V = {S,NP,VP,N,ART,V,a,the, boy ,girl,sees, knows, runs ) 

and 

VT = {the, boy, girl, sees, knows , runs ) . 

Hence, the set VN of non- terminals is 

VW = (S,NP,VP,N,ART,v) . 
S is the start symbol (for sentence ). 

P concains the following rules: 

S ->NP 
NP ->N 
NP -> ART N 
VP -> V 
VP -> V NP 

N -> boy N -> girl 

ART -> a ART -> the 

V -> runs V -> sees V -> knows 
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Hence, S produces IIP VP . Also, the string 
the boy 

is derivable from the string NP , This relationship is denoted by 

NP => the boy 
G 

where G (a reference to the grammar) may be omitted when the grammar 
is clear* 

The set of noun phrases is the set of all terminal strings derivable 
from the symbol NP . What we are interested in is the set of terminal 
strings in VTf that is derivable from the start symbol, i-e^ 

{a e VT+ ij S => a] . 
G 

This is the language of the grammar G , denoted by L(G) « 

Different kinds of generative grammars are obtained by putting 
restrictions on the production rules that may be in P . A type 0 or 
recursively enumerable grammar has no further restrictions placed upon 
it. A type 1 or context- sensitive grammar has only the restriction 
that if (a,b) is in P then |"b| >= l a l > where |a| is the number 
of symbols in a , the length of a . A type 2 or context-free grammar 
is context-sensitive plus if Ta^fcT is in P then ja|=l; further, 
only non- terminals may occur on the left-hand side of the derivation. 

Informally, let a context-free grammar G be a set of rewrite 
rules of the form ~ ~~ "~ " 

A -> Bl B2 . . . Bn , 

where n is any natural number, together with a start symbol S . The 
non-terminal symbols of G are the symbols that do not occur on the 
right-hand side of any rule, and the terminal symbols are the other 
symbols* Only a finite number of symbols and a finite number of rules 
are involved in a context-free grammar. The language of the grammar 
is the set of all strings of symbols that can be derived by an applica- 
tion of the rewrite rules starting with the start symbol. 

Further, let us attach to each rule p of the grammar G a 
parameter a(p) that is, intuitively, the conditional probability that 
the rule will be applied assuming that some rule with a given left-hand 
side is to be used. Each parameter must be in the interval [0,1] in 
order to be a meaningful probability. Also^ the sum of the parameters 
associated with the rules with a given left-hand side must be 1, in 
order to be consistent with the notion of conditional probability. 



Then, by a simple method described in Suppes (1970), it is possible 
to estimate the parameters for the rules of the grammar G such that 
the probability of getting the empirical distribution observed in the 
data is at a maximum; further, it is possible to test the goodness of 
fit by the standard chi-sqUare test. 1 — — 



